Evaluator 31

2018-10-16 14:23:56+00:00

2018-10-16 16:24:39+00:00

2:00:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 570, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 14, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

209

87

Template for ROS Submission

step2-scoring

success

yes

2018-10-15 21:16:06+00:00

2018-10-15 21:16:57+00:00

0:00:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

traveled_tiles_median	2
survival_time_mean	3.326666666666662
good_angle_mean	6.462894047823831
valid_direction_mean	1.8599999999999977

other stats

episodes	details {"ep000": {"nsteps": 118, "reward": -10.321366796554145, "good_angle": 17.27387241231916, "survival_time": 3.933333333333329, "traveled_tiles": 2, "valid_direction": 2.6999999999999953}, "ep001": {"nsteps": 250, "reward": -4.650436973587144, "good_angle": 11.852420089137292, "survival_time": 8.333333333333314, "traveled_tiles": 3, "valid_direction": 3.799999999999992}, "ep002": {"nsteps": 78, "reward": -13.940819608047605, "good_angle": 3.0579754911899313, "survival_time": 2.6000000000000005, "traveled_tiles": 1, "valid_direction": 2.333333333333334}, "ep003": {"nsteps": 26, "reward": -40.355483330213104, "good_angle": 0.10660259535936488, "survival_time": 0.8666666666666666, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep004": {"nsteps": 59, "reward": -18.98726426544836, "good_angle": 0.023599651113410176, "survival_time": 0.8999999999999999, "traveled_tiles": 3, "valid_direction": 0.033333333333333326}}
good_angle_max	17.27387241231916
good_angle_median	3.0579754911899313
good_angle_min	0.023599651113410176
reward_max	-4.650436973587144
reward_mean	-17.65107419477007
reward_median	-13.940819608047605
reward_min	-40.355483330213104
survival_time_max	8.333333333333314
survival_time_median	2.6000000000000005
survival_time_min	0.8666666666666666
traveled_tiles_max	3
traveled_tiles_mean	2
traveled_tiles_min	1
valid_direction_max	3.799999999999992
valid_direction_median	2.333333333333334
valid_direction_min	0.033333333333333326

No reset possible

205

78

ROS-based Lane Following

step2-scoring

success

yes

2018-10-15 21:15:32+00:00

2018-10-15 21:16:00+00:00

0:00:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

traveled_tiles_median	2
survival_time_mean	8.019999999999987
good_angle_mean	7.586644261053516
valid_direction_mean	6.613333333333321

other stats

episodes	details {"ep000": {"nsteps": 500, "reward": -0.5308841207069345, "good_angle": 12.688844425503396, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.299999999999986}, "ep001": {"nsteps": 34, "reward": -31.497156542013673, "good_angle": 2.4755854227500396, "survival_time": 1.1, "traveled_tiles": 3, "valid_direction": 1}, "ep002": {"nsteps": 371, "reward": -4.788737637174098, "good_angle": 10.34717417188025, "survival_time": 12.366666666666632, "traveled_tiles": 1, "valid_direction": 9.499999999999975}, "ep003": {"nsteps": 105, "reward": -10.759322019134247, "good_angle": 3.8967372891805994, "survival_time": 0.2333333333333333, "traveled_tiles": 3, "valid_direction": 2.3666666666666645}, "ep004": {"nsteps": 292, "reward": -4.7221411397905495, "good_angle": 8.524879995953293, "survival_time": 9.73333333333331, "traveled_tiles": 2, "valid_direction": 7.899999999999979}}
good_angle_max	12.688844425503396
good_angle_median	8.524879995953293
good_angle_min	2.4755854227500396
reward_max	-0.5308841207069345
reward_mean	-10.459648291763902
reward_median	-4.788737637174098
reward_min	-31.497156542013673
survival_time_max	16.666666666666654
survival_time_median	9.73333333333331
survival_time_min	0.2333333333333333
traveled_tiles_max	3
traveled_tiles_mean	2.2
traveled_tiles_min	1
valid_direction_max	12.299999999999986
valid_direction_median	7.899999999999979
valid_direction_min	1

No reset possible

199

94

Anna Tsalapova 🇷🇺

Random execution

step2-scoring

error

2018-10-15 20:53:32+00:00

2018-10-15 20:54:35+00:00

0:01:03

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 370, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/challenge_results.py", line 66, in read_challenge_results
    data = read_yaml_file(fn)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/yaml_utils.py", line 17, in read_yaml_file
    return yaml.load(data, Loader=yaml.Loader)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/main.py", line 924, in load
    return loader._constructor.get_single_data()
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 108, in get_single_data
    return self.construct_document(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 118, in construct_document
    for _dummy in generator:
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 672, in construct_yaml_map
    value = self.construct_mapping(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 399, in construct_mapping
    return BaseConstructor.construct_mapping(self, node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 242, in construct_mapping
    value = self.construct_object(value_node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 938, in construct_python_object_apply
    args = self.construct_sequence(node, deep=True)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 198, in construct_sequence
    return [self.construct_object(child, deep=deep) for child in node.value]
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 950, in construct_python_object_apply
    instance = self.make_python_instance(suffix, node, args, kwds, newobj)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 882, in make_python_instance
    cls = self.find_python_name(suffix, node.start_mark)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 835, in find_python_name
    mark,
ConstructorError: while constructing a Python object
cannot find module 'numpy' (No module named numpy)
  in "<byte string>", line 6, column 9:
          - &id001 !!python/object/apply:num ... 
            ^ (line: 6)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

195

80

ROS-based Lane Following, v2

step2-scoring

error

2018-10-15 20:51:53+00:00

2018-10-15 20:52:28+00:00

0:00:35

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 370, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/challenge_results.py", line 66, in read_challenge_results
    data = read_yaml_file(fn)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/yaml_utils.py", line 17, in read_yaml_file
    return yaml.load(data, Loader=yaml.Loader)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/main.py", line 924, in load
    return loader._constructor.get_single_data()
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 108, in get_single_data
    return self.construct_document(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 118, in construct_document
    for _dummy in generator:
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 672, in construct_yaml_map
    value = self.construct_mapping(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 399, in construct_mapping
    return BaseConstructor.construct_mapping(self, node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 242, in construct_mapping
    value = self.construct_object(value_node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 938, in construct_python_object_apply
    args = self.construct_sequence(node, deep=True)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 198, in construct_sequence
    return [self.construct_object(child, deep=deep) for child in node.value]
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 950, in construct_python_object_apply
    instance = self.make_python_instance(suffix, node, args, kwds, newobj)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 882, in make_python_instance
    cls = self.find_python_name(suffix, node.start_mark)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 835, in find_python_name
    mark,
ConstructorError: while constructing a Python object
cannot find module 'numpy' (No module named numpy)
  in "<byte string>", line 6, column 9:
          - &id001 !!python/object/apply:num ... 
            ^ (line: 6)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

181

80

ROS-based Lane Following, v2

step1-simulation

success

yes

2018-10-15 20:47:45+00:00

2018-10-15 20:51:47+00:00

0:04:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed

No reset possible

179

77

ROS-based Lane Following

step1-simulation

error

yes

2018-10-15 20:47:17+00:00

2018-10-15 20:47:39+00:00

0:00:22

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 356, in run
    pruned = client.networks.prune()
  File "/usr/local/lib/python2.7/dist-packages/docker/models/networks.py", line 214, in prune
    return self.client.api.prune_networks(filters=filters)
  File "/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py", line 34, in wrapper
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/network.py", line 174, in prune_networks
    return self._result(self._post(url, params=params), True)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/client.py", line 235, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/client.py", line 231, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python2.7/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
APIError: 409 Client Error: Conflict ("a prune operation is already running")

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

147

82

Andy Ser

Tensorflow template

step1-simulation

success

2018-10-15 11:08:27+00:00

2018-10-15 11:09:24+00:00

0:00:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed

No reset possible

129

74

Andrea Censi 🇨🇭

Random execution

step2-scoring

aborted

2018-10-14 23:52:39+00:00

2018-10-14 23:53:06+00:00

0:00:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

traveled_tiles_median	3
survival_time_mean	16.613333333333316
good_angle_mean	4.622046586172948
valid_direction_mean	11.759999999999994

other stats

episodes	details {"ep000": {"nsteps": 500, "reward": -0.6687548997402191, "good_angle": 2.346875555585716, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 9.099999999999994}, "ep001": {"nsteps": 500, "reward": -2.053634369403124, "good_angle": 1.1012067416734153, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 6.933333333333344}, "ep002": {"nsteps": 500, "reward": -1.511635816635564, "good_angle": 11.962119726476049, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 14.399999999999984}, "ep003": {"nsteps": 500, "reward": -1.2118231953382492, "good_angle": 4.620920989414631, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.76666666666666}, "ep004": {"nsteps": 500, "reward": -0.47050132013599794, "good_angle": 3.07910991771493, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.599999999999987}}
good_angle_max	11.962119726476049
good_angle_median	3.07910991771493
good_angle_min	1.1012067416734153
reward_max	-0.47050132013599794
reward_mean	-1.183269920250631
reward_median	-1.2118231953382492
reward_min	-2.053634369403124
survival_time_max	16.666666666666654
survival_time_median	16.599999999999984
survival_time_min	16.599999999999984
traveled_tiles_max	3
traveled_tiles_mean	2.4
traveled_tiles_min	1
valid_direction_max	14.599999999999987
valid_direction_median	13.76666666666666
valid_direction_min	6.933333333333344

No reset possible

121

71

Andrea Censi 🇨🇭

Random execution

step2-scoring

success