Evaluator 4782

ID	4782
evaluator	`gpu-prod-01`
owner	I don't have one 😀
machine	gpu_3d45da58109a
process	gpu-prod-01_3d45da58109a
version	6.2.5
first heard	2020-12-02 00:56:45+00:00
last heard	2020-12-02 14:41:05+00:00
status	inactive
# evaluating
# success
# timeout	2 `50199`
# failed	15 `47675`
# error	55 `47817`
# aborted	12 `47314`
# host-error	18 `47859`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID	submission	user	user label	challenge	step	status	up to date	evaluator	date started	date completed	duration	message
`52692`	`11772`	Ehsan Ahmadi 🇨🇦	template-random	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`gpu-prod-01`	2020-12-02 12:52:26+00:00	2020-12-02 12:52:50+00:00	0:00:24	Uncaught exception: [...] Uncaught exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status response.raise_for_status() File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True) File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull self._raise_for_status(response) File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status raise create_api_error_from_http_exception(e) File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception raise cls(e, response=response, explanation=explanation) docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied") The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry return docker_pull(client, image_name, quiet=quiet) File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull raise PullError(msg) from e duckietown_build_utils.docker_pulling.PullError: Cannot pull repo docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798 tag None The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr cr = run_single( File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single docker_pull_retry(client, image, ntimes=4, wait=5) File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry raise PullError(msg) from e duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52621`	`6757`	Liam Paull 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	failed	no	`gpu-prod-01`	2020-12-02 12:09:54+00:00	2020-12-02 12:13:27+00:00	0:03:33	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main raise InvalidSubmission(msg) duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52550`	`6816`	Anthony Courchesne 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 11:59:42+00:00	2020-12-02 12:09:30+00:00	0:09:48	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140064356730864 - M:video_aido:cmdline(in:/;out:/) 140064356731776 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52461`	`6850`	Himanshu Arora 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 11:43:05+00:00	2020-12-02 11:57:53+00:00	0:14:48	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140103820572080 - M:video_aido:cmdline(in:/;out:/) 140103820571024 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52401`	`9255`	Jerome Labonte 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 11:33:50+00:00	2020-12-02 11:40:39+00:00	0:06:49	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140119265674240 - M:video_aido:cmdline(in:/;out:/) 140119265673280 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52307`	`9337`	Jerome Labonte 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 11:21:32+00:00	2020-12-02 11:31:03+00:00	0:09:31	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139625437628592 - M:video_aido:cmdline(in:/;out:/) 139625104954560 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52276`	`9333`	Himanshu Arora 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 11:17:22+00:00	2020-12-02 11:20:40+00:00	0:03:18	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139701016434336 - M:video_aido:cmdline(in:/;out:/) 139701016477808 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52242`	`9370`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 11:12:55+00:00	2020-12-02 11:15:26+00:00	0:02:31	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140477537844720 - M:video_aido:cmdline(in:/;out:/) 140477538291184 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52209`	`9373`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 11:10:33+00:00	2020-12-02 11:12:38+00:00	0:02:05	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140582627362032 - M:video_aido:cmdline(in:/;out:/) 140582627456576 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52142`	`10019`	Jean-Sébastien Grondin 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 11:00:56+00:00	2020-12-02 11:10:01+00:00	0:09:05	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140302804742784 - M:video_aido:cmdline(in:/;out:/) 140302805116096 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52077`	`10018`	Jean-Sébastien Grondin 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 10:50:45+00:00	2020-12-02 10:58:54+00:00	0:08:09	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140102359654064 - M:video_aido:cmdline(in:/;out:/) 140102359670448 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52063`	`10067`	Étienne Boucher 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 10:46:40+00:00	2020-12-02 10:49:52+00:00	0:03:12	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139817309815136 - M:video_aido:cmdline(in:/;out:/) 139817310000608 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`52023`	`10033`	Liam Paull 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	failed	no	`gpu-prod-01`	2020-12-02 10:42:06+00:00	2020-12-02 10:44:50+00:00	0:02:44	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main raise InvalidSubmission(msg) duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51958`	`10045`	Jean-Sébastien Grondin 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	host-error	no	`gpu-prod-01`	2020-12-02 10:32:16+00:00	2020-12-02 10:41:05+00:00	0:08:49	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51935`	`10933`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`gpu-prod-01`	2020-12-02 10:30:01+00:00	2020-12-02 10:31:33+00:00	0:01:32	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51846`	`10722`	Dishank Bansal 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 10:20:08+00:00	2020-12-02 10:27:44+00:00	0:07:36	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139648691128208 - M:video_aido:cmdline(in:/;out:/) 139648691171280 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51766`	`10759`	Melisande Teng	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	host-error	no	`gpu-prod-01`	2020-12-02 10:10:57+00:00	2020-12-02 10:14:38+00:00	0:03:41	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51729`	`10770`	Fernanda Custodio Pereira do Carmo 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 10:06:06+00:00	2020-12-02 10:09:25+00:00	0:03:19	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140412817711408 - M:video_aido:cmdline(in:/;out:/) 140412816459328 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51703`	`10787`	Fernanda Custodio Pereira do Carmo 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 10:03:15+00:00	2020-12-02 10:05:50+00:00	0:02:35	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139739873155680 - M:video_aido:cmdline(in:/;out:/) 139739873136064 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51666`	`10833`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	failed	no	`gpu-prod-01`	2020-12-02 09:58:42+00:00	2020-12-02 10:03:06+00:00	0:04:24	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over raise TimeoutError(msg) from None TimeoutError: Timeout while reading output of node "ego0". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode r: MsgReceived = await loop.run_in_executor(executor, f) File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(self.args, *self.kwargs) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one raise TimeoutError(msg) from e TimeoutError: Timeout detected on /fifos/ego0-out after 6 messages. Expected topic "commands". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51624`	`10812`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	failed	no	`gpu-prod-01`	2020-12-02 09:54:17+00:00	2020-12-02 09:57:11+00:00	0:02:54	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over raise TimeoutError(msg) from None TimeoutError: Timeout while reading output of node "ego0". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode r: MsgReceived = await loop.run_in_executor(executor, f) File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(self.args, *self.kwargs) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one raise TimeoutError(msg) from e TimeoutError: Timeout detected on /fifos/ego0-out after 5 messages. Expected topic "commands". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51536`	`10844`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 09:44:21+00:00	2020-12-02 09:54:06+00:00	0:09:45	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139884972443872 - M:video_aido:cmdline(in:/;out:/) 139884972444928 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51475`	`10858`	Daniil Lisus	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 09:37:23+00:00	2020-12-02 09:43:27+00:00	0:06:04	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140382090234128 - M:video_aido:cmdline(in:/;out:/) 140382090234992 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51403`	`10879`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 09:30:09+00:00	2020-12-02 09:35:34+00:00	0:05:25	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139632261024304 - M:video_aido:cmdline(in:/;out:/) 139632261024160 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51312`	`10896`	Dishank Bansal 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 09:20:36+00:00	2020-12-02 09:29:43+00:00	0:09:07	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140148053028672 - M:video_aido:cmdline(in:/;out:/) 140148053050416 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51302`	`11010`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`gpu-prod-01`	2020-12-02 09:19:15+00:00	2020-12-02 09:20:01+00:00	0:00:46	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51275`	`10906`	Himanshu Arora 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 09:15:29+00:00	2020-12-02 09:18:44+00:00	0:03:15	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140208679316016 - M:video_aido:cmdline(in:/;out:/) 140208679314384 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51244`	`11012`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`gpu-prod-01`	2020-12-02 09:12:58+00:00	2020-12-02 09:14:50+00:00	0:01:52	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51149`	`10939`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 09:01:09+00:00	2020-12-02 09:11:08+00:00	0:09:59	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140395005282480 - M:video_aido:cmdline(in:/;out:/) 140395005283536 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51083`	`10961`	Himanshu Arora 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 08:52:48+00:00	2020-12-02 09:00:57+00:00	0:08:09	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140504137544992 - M:video_aido:cmdline(in:/;out:/) 140504137376768 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`51002`	`10985`	Fernanda Custodio Pereira do Carmo 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 08:44:54+00:00	2020-12-02 08:52:37+00:00	0:07:43	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140550131709840 - M:video_aido:cmdline(in:/;out:/) 140550132006192 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50972`	`10990`	Fernanda Custodio Pereira do Carmo 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 08:42:01+00:00	2020-12-02 08:44:41+00:00	0:02:40	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140372086080128 - M:video_aido:cmdline(in:/;out:/) 140372086082000 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50914`	`11022`	Fernanda Custodio Pereira do Carmo 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 08:33:18+00:00	2020-12-02 08:41:12+00:00	0:07:54	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140707953115632 - M:video_aido:cmdline(in:/;out:/) 140707953558144 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50837`	`11065`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 08:24:59+00:00	2020-12-02 08:32:44+00:00	0:07:45	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140045048973392 - M:video_aido:cmdline(in:/;out:/) 140045048974016 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50811`	`11286`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 08:21:13+00:00	2020-12-02 08:23:41+00:00	0:02:28	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140370203296480 - M:video_aido:cmdline(in:/;out:/) 140374475426928 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50711`	`11092`	Melisande Teng	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 08:12:28+00:00	2020-12-02 08:19:14+00:00	0:06:46	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140651665486512 - M:video_aido:cmdline(in:/;out:/) 140651665489536 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50656`	`11157`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 08:09:20+00:00	2020-12-02 08:11:42+00:00	0:02:22	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139889761359424 - M:video_aido:cmdline(in:/;out:/) 139889761361872 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50606`	`11305`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	failed	no	`gpu-prod-01`	2020-12-02 08:06:18+00:00	2020-12-02 08:08:58+00:00	0:02:40	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode r: MsgReceived = await loop.run_in_executor(executor, f) File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(self.args, self.kwargs) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over raise RemoteNodeAborted(m) zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted: error in ego0 \|Exception while handling a message on topic "get_commands". \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop \|\| handle_message_node(parsed, receiver0, context0) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node \|\| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(*kwargs) \|\| File "solution.py", line 70, in on_received_get_commands \|\| velocity, omega = self.compute_action(self.current_image) \|\| File "solution.py", line 67, in compute_action \|\| return action.astype(float) \|\| AttributeError: 'Tensor' object has no attribute 'astype' \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50532`	`11116`	Melisande Teng	real-exercise-1	`aido5-LF-sim-validation`	LFv-sim	failed	no	`gpu-prod-01`	2020-12-02 08:01:45+00:00	2020-12-02 08:05:58+00:00	0:04:13	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main raise InvalidSubmission(msg) duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50396`	`11300`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	timeout	no	`gpu-prod-01`	2020-12-02 07:44:16+00:00	2020-12-02 08:00:32+00:00	0:16:16	Timeout because eval [...] `Timeout because evaluator contacted us`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50356`	`11152`	Dishank Bansal 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	host-error	no	`gpu-prod-01`	2020-12-02 07:37:38+00:00	2020-12-02 07:43:49+00:00	0:06:11	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50312`	`11301`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 07:33:03+00:00	2020-12-02 07:35:05+00:00	0:02:02	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139921436398976 - M:video_aido:cmdline(in:/;out:/) 139921436398832 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50199`	`11311`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	timeout	no	`gpu-prod-01`	2020-12-02 07:19:07+00:00	2020-12-02 07:32:47+00:00	0:13:40	Timeout because eval [...] `Timeout because evaluator contacted us`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50169`	`11289`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 07:15:32+00:00	2020-12-02 07:17:24+00:00	0:01:52	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139979159420640 - M:video_aido:cmdline(in:/;out:/) 139979159420880 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50109`	`11367`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 07:08:44+00:00	2020-12-02 07:15:01+00:00	0:06:17	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140352149576240 - M:video_aido:cmdline(in:/;out:/) 140352149574272 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`50045`	`11306`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	failed	no	`gpu-prod-01`	2020-12-02 06:59:21+00:00	2020-12-02 07:05:29+00:00	0:06:08	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode r: MsgReceived = await loop.run_in_executor(executor, f) File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(self.args, self.kwargs) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over raise RemoteNodeAborted(m) zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted: error in ego0 \|Exception while handling a message on topic "get_commands". \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop \|\| handle_message_node(parsed, receiver0, context0) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node \|\| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(*kwargs) \|\| File "solution.py", line 70, in on_received_get_commands \|\| velocity, omega = self.compute_action(self.current_image) \|\| File "solution.py", line 66, in compute_action \|\| action = self.model.predict(observation) \|\| File "/workspace/model.py", line 138, in predict \|\| return output.cpu().numpy().flatten() \|\| RuntimeError: Can't call numpy() on Tensor that requires grad. Use tensor.detach().numpy() instead. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49991`	`11371`	Yishu Malhotra 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 06:52:20+00:00	2020-12-02 06:58:19+00:00	0:05:59	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140324445572544 - M:video_aido:cmdline(in:/;out:/) 140325850463584 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49920`	`11391`	Charlie Gauthier 🇨🇦	Baseline solution using reinforcement learning	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 06:41:33+00:00	2020-12-02 06:51:28+00:00	0:09:55	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139909108668736 - M:video_aido:cmdline(in:/;out:/) 139909108704640 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49829`	`11437`	Charlie Gauthier 🇨🇦	template-rpl-ros	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 06:30:04+00:00	2020-12-02 06:39:39+00:00	0:09:35	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139650626433568 - M:video_aido:cmdline(in:/;out:/) 139650626436928 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49780`	`11441`	Riccardo Tresa 🇮🇹	template-random	`aido5-LF-sim-validation`	LFv-sim	host-error	no	`gpu-prod-01`	2020-12-02 06:23:58+00:00	2020-12-02 06:29:56+00:00	0:05:58	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49708`	`11456`	Mo Kleit 🇨🇦	real-exercise-1-fallback	`aido5-LF-sim-validation`	LFv-sim	host-error	no	`gpu-prod-01`	2020-12-02 06:14:02+00:00	2020-12-02 06:22:07+00:00	0:08:05	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49652`	`11512`	Jean-Sébastien Grondin 🇨🇦	exercise_state_estimation	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 06:05:14+00:00	2020-12-02 06:13:39+00:00	0:08:25	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140653517112512 - M:video_aido:cmdline(in:/;out:/) 140653515998688 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49592`	`11545`	Himanshu Arora 🇨🇦	sim-exercise-2	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 05:55:50+00:00	2020-12-02 06:04:57+00:00	0:09:07	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139861373489888 - M:video_aido:cmdline(in:/;out:/) 139861697951152 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49526`	`11624`	Anthony Courchesne 🇨🇦	TNetR1	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 05:46:57+00:00	2020-12-02 05:55:09+00:00	0:08:12	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140283638794368 - M:video_aido:cmdline(in:/;out:/) 140283638795280 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49503`	`11564`	Yishu Malhotra 🇨🇦	sim-exercise-2	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 05:44:11+00:00	2020-12-02 05:46:30+00:00	0:02:19	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140440155214848 - M:video_aido:cmdline(in:/;out:/) 140440155630896 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49482`	`12245`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	host-error	no	`gpu-prod-01`	2020-12-02 05:41:24+00:00	2020-12-02 05:43:00+00:00	0:01:36	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49395`	`11644`	Dishank Bansal 🇨🇦	exercise_state_estimation	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 05:31:40+00:00	2020-12-02 05:40:46+00:00	0:09:06	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140701478986560 - M:video_aido:cmdline(in:/;out:/) 140701478903872 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49291`	`11705`	brian wong	baseline-RL-sim-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 05:18:59+00:00	2020-12-02 05:30:54+00:00	0:11:55	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140003593262128 - M:video_aido:cmdline(in:/;out:/) 140003593262224 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49277`	`12237`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`gpu-prod-01`	2020-12-02 05:17:30+00:00	2020-12-02 05:18:31+00:00	0:01:01	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49256`	`12237`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`gpu-prod-01`	2020-12-02 05:15:44+00:00	2020-12-02 05:16:59+00:00	0:01:15	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49234`	`12236`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	host-error	no	`gpu-prod-01`	2020-12-02 05:12:37+00:00	2020-12-02 05:15:15+00:00	0:02:38	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49136`	`11782`	Kaiyi Chen 🇺🇸	KK Net	`aido5-LF-sim-validation`	LFv-sim	error	no	`gpu-prod-01`	2020-12-02 05:02:23+00:00	2020-12-02 05:12:01+00:00	0:09:38	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139632550348064 - M:video_aido:cmdline(in:/;out:/) 139632550350416 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49120`	`12297`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`gpu-prod-01`	2020-12-02 05:01:05+00:00	2020-12-02 05:02:05+00:00	0:01:00	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49107`	`12297`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`gpu-prod-01`	2020-12-02 04:59:24+00:00	2020-12-02 05:00:27+00:00	0:01:03	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49083`	`12305`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	host-error	no	`gpu-prod-01`	2020-12-02 04:57:55+00:00	2020-12-02 04:59:01+00:00	0:01:06	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49067`	`12305`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	host-error	no	`gpu-prod-01`	2020-12-02 04:56:03+00:00	2020-12-02 04:57:12+00:00	0:01:09	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`49042`	`12296`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	host-error	no	`gpu-prod-01`	2020-12-02 04:54:43+00:00	2020-12-02 04:55:46+00:00	0:01:03	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48971`	`12243`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI-sim-validation`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 04:49:07+00:00	2020-12-02 04:54:35+00:00	0:05:28	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139949512899744 - M:video_aido:cmdline(in:/;out:/) 139949512251376 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48693`	`12312`	Bea Baselines 🐤	template-pytorch	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	error	no	`gpu-prod-01`	2020-12-02 04:14:59+00:00	2020-12-02 04:48:54+00:00	0:33:55	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139683272507936 - M:video_aido:cmdline(in:/;out:/) 139683271104880 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48656`	`12315`	Bea Baselines 🐤	template-pytorch	`aido5-LFI-full-sim-validation`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 04:11:26+00:00	2020-12-02 04:14:37+00:00	0:03:11	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139648906852528 - M:video_aido:cmdline(in:/;out:/) 139648906726416 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48559`	`12275`	Bea Baselines 🐤	baseline-duckietown	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 04:01:47+00:00	2020-12-02 04:11:00+00:00	0:09:13	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140174381258640 - M:video_aido:cmdline(in:/;out:/) 140174382916032 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48500`	`12180`	Bea Baselines 🐤	template-tensorflow	`aido5-LFI-full-sim-validation`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 03:59:15+00:00	2020-12-02 04:01:32+00:00	0:02:17	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139739708084816 - M:video_aido:cmdline(in:/;out:/) 139739708679456 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48478`	`12178`	Bea Baselines 🐤	template-tensorflow	`aido5-LFI-sim-validation`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 03:57:24+00:00	2020-12-02 03:59:01+00:00	0:01:37	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140191480147680 - M:video_aido:cmdline(in:/;out:/) 140186417952512 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48426`	`12183`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI-sim-validation`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 03:51:40+00:00	2020-12-02 03:57:09+00:00	0:05:29	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140084574572608 - M:video_aido:cmdline(in:/;out:/) 140084574575296 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48407`	`12206`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	failed	no	`gpu-prod-01`	2020-12-02 03:50:24+00:00	2020-12-02 03:51:19+00:00	0:00:55	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48371`	`12209`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFI-sim-testing`	LFVIv-sim	failed	no	`gpu-prod-01`	2020-12-02 03:48:49+00:00	2020-12-02 03:49:51+00:00	0:01:02	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48346`	`12209`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFI-sim-testing`	LFVIv-sim	host-error	no	`gpu-prod-01`	2020-12-02 03:47:17+00:00	2020-12-02 03:48:24+00:00	0:01:07	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48329`	`12211`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LF-sim-testing`	LFt-sim	failed	no	`gpu-prod-01`	2020-12-02 03:46:28+00:00	2020-12-02 03:47:09+00:00	0:00:41	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48313`	`12211`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LF-sim-testing`	LFt-sim	failed	no	`gpu-prod-01`	2020-12-02 03:45:38+00:00	2020-12-02 03:46:20+00:00	0:00:42	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48286`	`12218`	Bea Baselines 🐤	straight	`aido5-LFI-full-sim-testing`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 03:43:11+00:00	2020-12-02 03:45:31+00:00	0:02:20	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140316602488192 - M:video_aido:cmdline(in:/;out:/) 140316602523952 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48258`	`12223`	Bea Baselines 🐤	straight	`aido5-LFI-sim-validation`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 03:41:11+00:00	2020-12-02 03:42:51+00:00	0:01:40	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140674405168752 - M:video_aido:cmdline(in:/;out:/) 140674405168176 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48238`	`12226`	Bea Baselines 🐤	straight	`aido5-LF-sim-testing`	LFt-sim	error	no	`gpu-prod-01`	2020-12-02 03:39:33+00:00	2020-12-02 03:41:02+00:00	0:01:29	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140499229242992 - M:video_aido:cmdline(in:/;out:/) 140499228642848 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48175`	`11756`	Ayman Shams 🇨🇦	exercise_state_estimation	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`gpu-prod-01`	2020-12-02 03:38:20+00:00	2020-12-02 03:39:08+00:00	0:00:48	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48055`	`12159`	Bea Baselines 🐤	template-pytorch	`aido5-LFP-sim-validation`	LFP-sim	aborted	no	`gpu-prod-01`	2020-12-02 03:26:59+00:00	2020-12-02 03:37:43+00:00	0:10:44	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48047`	`12177`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`gpu-prod-01`	2020-12-02 03:25:45+00:00	2020-12-02 03:26:52+00:00	0:01:07	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`48019`	`12163`	Bea Baselines 🐤	template-pytorch	`aido5-LFI-sim-validation`	LFVIv-sim	error	no	`gpu-prod-01`	2020-12-02 03:23:48+00:00	2020-12-02 03:25:29+00:00	0:01:41	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140548384151776 - M:video_aido:cmdline(in:/;out:/) 140548377904704 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47934`	`12169`	Bea Baselines 🐤	template-pytorch	`aido5-LFVI-sim-testing`	LFVIt-sim	error	no	`gpu-prod-01`	2020-12-02 03:16:55+00:00	2020-12-02 03:23:28+00:00	0:06:33	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139678783489216 - M:video_aido:cmdline(in:/;out:/) 139678783489504 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47911`	`12176`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	host-error	no	`gpu-prod-01`	2020-12-02 03:15:40+00:00	2020-12-02 03:16:40+00:00	0:01:00	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47876`	`12184`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI-sim-testing`	LFVIt-sim	error	no	`gpu-prod-01`	2020-12-02 03:12:23+00:00	2020-12-02 03:15:11+00:00	0:02:48	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140457071997472 - M:video_aido:cmdline(in:/;out:/) 140457072007680 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47859`	`12185`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	host-error	no	`gpu-prod-01`	2020-12-02 03:10:59+00:00	2020-12-02 03:12:02+00:00	0:01:03	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47841`	`12181`	Bea Baselines 🐤	template-tensorflow	`aido5-LF-sim-testing`	LFt-sim	error	no	`gpu-prod-01`	2020-12-02 03:08:54+00:00	2020-12-02 03:10:25+00:00	0:01:31	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140332919057856 - M:video_aido:cmdline(in:/;out:/) 140332919056752 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47817`	`12184`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI-sim-testing`	LFVIt-sim	error	no	`gpu-prod-01`	2020-12-02 03:05:47+00:00	2020-12-02 03:08:33+00:00	0:02:46	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140059087863280 - M:video_aido:cmdline(in:/;out:/) 140059087863760 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47792`	`12214`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI-sim-testing`	LFVIt-sim	failed	no	`gpu-prod-01`	2020-12-02 03:04:06+00:00	2020-12-02 03:05:18+00:00	0:01:12	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47724`	`12210`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFI-full-sim-validation`	LFVIv-sim	failed	no	`gpu-prod-01`	2020-12-02 03:00:05+00:00	2020-12-02 03:03:45+00:00	0:03:40	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47709`	`12213`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI-sim-validation`	LFVIv-sim	failed	no	`gpu-prod-01`	2020-12-02 02:58:28+00:00	2020-12-02 02:59:39+00:00	0:01:11	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47675`	`12210`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFI-full-sim-validation`	LFVIv-sim	failed	no	`gpu-prod-01`	2020-12-02 02:56:43+00:00	2020-12-02 02:58:03+00:00	0:01:20	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47562`	`11882`	Bea Baselines 🐤	straight	`aido5-LFVI-sim-validation`	LFVIv-sim	aborted	no	`gpu-prod-01`	2020-12-02 02:21:07+00:00	2020-12-02 02:56:08+00:00	0:35:01	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47497`	`12214`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI-sim-testing`	LFVIt-sim	aborted	no	`gpu-prod-01`	2020-12-02 02:18:05+00:00	2020-12-02 02:21:01+00:00	0:02:56	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47455`	`11875`	Bea Baselines 🐤	straight	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	aborted	no	`gpu-prod-01`	2020-12-02 02:04:31+00:00	2020-12-02 02:17:55+00:00	0:13:24	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47422`	`11881`	Bea Baselines 🐤	straight	`aido5-LFV-sim-testing`	LFVv-sim	aborted	no	`gpu-prod-01`	2020-12-02 02:03:20+00:00	2020-12-02 02:04:01+00:00	0:00:41	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47366`	`11870`	Bea Baselines 🐤	straight	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`gpu-prod-01`	2020-12-02 02:02:10+00:00	2020-12-02 02:02:46+00:00	0:00:36	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`47314`	`9367`	Jean-Sébastien Grondin 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`gpu-prod-01`	2020-12-02 00:56:58+00:00	2020-12-02 02:02:03+00:00	1:05:05	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible