Duckietown Challenges Home Challenges Submissions

Evaluator 30

ID30
evaluatornutonomy-P50-30037
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-30037
version3.0.27
first heard
last heard
statusinactive
# evaluating
# success20 137
# timeout
# failed2 133
# error5 182
# aborted2 184
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
227118Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score181.98830674061868


No reset possible
226117Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score14.089530130010317


No reset possible
225116Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score162.26540493401069


No reset possible
224115Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score146.27308938815169


No reset possible
223114Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score118.913421047069903


No reset possible
222113Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score116.80020348621838


No reset possible
221112Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score179.80851423234785


No reset possible
220111Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score125.92210848810342


No reset possible
219110Yash Gaurkar 🇮🇳Solution templateaido1_luck-v3step1successyesnutonomy-P50-300372:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score16.392911259141016


No reset possible
217108Brian Wang 🇺🇸Random executionaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-300370:00:10
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 354, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 507, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job217-4284', 'pull']:

   >  Command '['docker-compose', '-p', 'job217-4284', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
213104Brian Wang 🇺🇸Solution templateaido1_luck-v3step1erroryesnutonomy-P50-300370:00:10
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 354, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 507, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job213-7644', 'pull']:

   >  Command '['docker-compose', '-p', 'job213-7644', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20374Andrea Censi 🇨🇭Random executionaido1_LF1_r2-v3step2-scoringabortedyesnutonomy-P50-300370:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean23.432233238060338
valid_direction_mean11.559999999999992


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.8830052211284637, "good_angle": 9.560625696442672, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.233333333333336}, "ep001": {"nsteps": 500, "reward": -1.292024236717727, "good_angle": 38.617643875411616, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.3}, "ep002": {"nsteps": 500, "reward": -1.5498077857494357, "good_angle": 37.16335017231948, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 11.166666666666664}, "ep003": {"nsteps": 500, "reward": -1.175085791170597, "good_angle": 18.324050322118843, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.499999999999991}, "ep004": {"nsteps": 500, "reward": -1.0901485322117803, "good_angle": 13.495496124009067, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.599999999999964}}
good_angle_max38.617643875411616
good_angle_median18.324050322118843
good_angle_min9.560625696442672
reward_max-0.8830052211284637
reward_mean-1.1980143133956007
reward_median-1.175085791170597
reward_min-1.5498077857494357
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max12.499999999999991
valid_direction_median11.3
valid_direction_min11.166666666666664
No reset possible
19694Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-300370:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
19391Anna Tsalapova 🇷🇺Solution templateaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-300370:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 368, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 507, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job193-4865', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job193-4865', 'up', '--abort-on-container-exit']' returned non-zero exit status 2

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19287Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r2-v3step2-scoringerrornonutonomy-P50-300370:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 370, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/challenge_results.py", line 66, in read_challenge_results
    data = read_yaml_file(fn)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/yaml_utils.py", line 17, in read_yaml_file
    return yaml.load(data, Loader=yaml.Loader)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/main.py", line 924, in load
    return loader._constructor.get_single_data()
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 108, in get_single_data
    return self.construct_document(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 118, in construct_document
    for _dummy in generator:
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 672, in construct_yaml_map
    value = self.construct_mapping(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 399, in construct_mapping
    return BaseConstructor.construct_mapping(self, node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 242, in construct_mapping
    value = self.construct_object(value_node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 938, in construct_python_object_apply
    args = self.construct_sequence(node, deep=True)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 198, in construct_sequence
    return [self.construct_object(child, deep=deep) for child in node.value]
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 950, in construct_python_object_apply
    instance = self.make_python_instance(suffix, node, args, kwds, newobj)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 882, in make_python_instance
    cls = self.find_python_name(suffix, node.start_mark)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 835, in find_python_name
    mark,
ConstructorError: while constructing a Python object
cannot find module 'numpy' (No module named numpy)
  in "<byte string>", line 6, column 9:
          - &id001 !!python/object/apply:num ... 
            ^ (line: 6)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18887Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-300370:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
18474Andrea Censi 🇨🇭Random executionaido1_LF1_r2-v3step2-scoringabortednonutonomy-P50-300370:00:29
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 370, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/challenge_results.py", line 66, in read_challenge_results
    data = read_yaml_file(fn)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/yaml_utils.py", line 17, in read_yaml_file
    return yaml.load(data, Loader=yaml.Loader)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/main.py", line 924, in load
    return loader._constructor.get_single_data()
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 108, in get_single_data
    return self.construct_document(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 118, in construct_document
    for _dummy in generator:
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 672, in construct_yaml_map
    value = self.construct_mapping(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 399, in construct_mapping
    return BaseConstructor.construct_mapping(self, node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 242, in construct_mapping
    value = self.construct_object(value_node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 938, in construct_python_object_apply
    args = self.construct_sequence(node, deep=True)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 198, in construct_sequence
    return [self.construct_object(child, deep=deep) for child in node.value]
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 950, in construct_python_object_apply
    instance = self.make_python_instance(suffix, node, args, kwds, newobj)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 882, in make_python_instance
    cls = self.find_python_name(suffix, node.start_mark)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 835, in find_python_name
    mark,
ConstructorError: while constructing a Python object
cannot find module 'numpy' (No module named numpy)
  in "<byte string>", line 6, column 9:
          - &id001 !!python/object/apply:num ... 
            ^ (line: 6)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18271Andrea Censi 🇨🇭Random executionaido1_LF1_r2-v3step2-scoringerrornonutonomy-P50-300370:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 370, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/challenge_results.py", line 66, in read_challenge_results
    data = read_yaml_file(fn)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/yaml_utils.py", line 17, in read_yaml_file
    return yaml.load(data, Loader=yaml.Loader)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/main.py", line 924, in load
    return loader._constructor.get_single_data()
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 108, in get_single_data
    return self.construct_document(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 118, in construct_document
    for _dummy in generator:
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 672, in construct_yaml_map
    value = self.construct_mapping(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 399, in construct_mapping
    return BaseConstructor.construct_mapping(self, node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 242, in construct_mapping
    value = self.construct_object(value_node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 938, in construct_python_object_apply
    args = self.construct_sequence(node, deep=True)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 198, in construct_sequence
    return [self.construct_object(child, deep=deep) for child in node.value]
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 950, in construct_python_object_apply
    instance = self.make_python_instance(suffix, node, args, kwds, newobj)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 882, in make_python_instance
    cls = self.find_python_name(suffix, node.start_mark)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 835, in find_python_name
    mark,
ConstructorError: while constructing a Python object
cannot find module 'numpy' (No module named numpy)
  in "<byte string>", line 6, column 9:
          - &id001 !!python/object/apply:num ... 
            ^ (line: 6)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17571Andrea Censi 🇨🇭Random executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-300370:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
174103Maxim Kuzmin 🇷🇺Solution templateaido1_luck-v3step1successyesnutonomy-P50-300370:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score126.680201249419294


No reset possible
15788Bhairav MehtaROS-based Lane Followingaido1_LF1_r2-v3step2-scoringsuccessnonutonomy-P50-300370:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean7.53999999999999
good_angle_mean0.087122878981241
valid_direction_mean2.640000000000003


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.469285973056918, "good_angle": -3.630699501258958, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.56666666666668}, "ep001": {"nsteps": 315, "reward": -3.642068651283071, "good_angle": 4.130788689020387, "survival_time": 10.46666666666664, "traveled_tiles": 3, "valid_direction": 2.566666666666665}, "ep002": {"nsteps": 128, "reward": -10.123465796466917, "good_angle": -1.7056225876897235, "survival_time": 4.266666666666661, "traveled_tiles": 1, "valid_direction": 2.533333333333333}, "ep003": {"nsteps": 163, "reward": -8.262395232001696, "good_angle": 1.1129175598194612, "survival_time": 3.433333333333331, "traveled_tiles": 4, "valid_direction": 1.5333333333333343}, "ep004": {"nsteps": 86, "reward": -14.037436504696691, "good_angle": 0.5282302350150381, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max4.130788689020387
good_angle_median0.5282302350150381
good_angle_min-3.630699501258958
reward_max-0.469285973056918
reward_mean-7.306930431501058
reward_median-8.262395232001696
reward_min-14.037436504696691
survival_time_max16.666666666666654
survival_time_median4.266666666666661
survival_time_min2.8666666666666663
traveled_tiles_max5
traveled_tiles_mean2.8
traveled_tiles_min1
valid_direction_max6.56666666666668
valid_direction_median2.533333333333333
valid_direction_min0
No reset possible
15687Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r2-v3step2-scoringsuccessnonutonomy-P50-300370:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean5.053333333333326
good_angle_mean3.7818392451346305
valid_direction_mean2.8733333333333277


other stats
episodes
details{"ep000": {"nsteps": 130, "reward": -9.819136573259646, "good_angle": 5.211910507341221, "survival_time": 4.333333333333328, "traveled_tiles": 2, "valid_direction": 3.199999999999994}, "ep001": {"nsteps": 262, "reward": -5.332834410236341, "good_angle": 5.5484162150213905, "survival_time": 8.733333333333313, "traveled_tiles": 3, "valid_direction": 4.333333333333324}, "ep002": {"nsteps": 83, "reward": -13.371291945452793, "good_angle": 3.3840487120196996, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 2.0999999999999996}, "ep003": {"nsteps": 200, "reward": -6.201393569028005, "good_angle": 1.7510460804000738, "survival_time": 5.733333333333323, "traveled_tiles": 4, "valid_direction": 2.466666666666658}, "ep004": {"nsteps": 111, "reward": -13.004716767921105, "good_angle": 3.0137747108907673, "survival_time": 3.6999999999999966, "traveled_tiles": 2, "valid_direction": 2.266666666666662}}
good_angle_max5.5484162150213905
good_angle_median3.3840487120196996
good_angle_min1.7510460804000738
reward_max-5.332834410236341
reward_mean-9.545874653179578
reward_median-9.819136573259646
reward_min-13.371291945452793
survival_time_max8.733333333333313
survival_time_median4.333333333333328
survival_time_min2.7666666666666666
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max4.333333333333324
valid_direction_median2.466666666666658
valid_direction_min2.0999999999999996
No reset possible
15487Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r2-v3step1-simulationsuccessnonutonomy-P50-300370:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
15386Bhairav MehtaROS-based Lane Followingaido1_LF1_r2-v3step2-scoringsuccessnonutonomy-P50-300370:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean7.506666666666656
good_angle_mean-0.03157121038480195
valid_direction_mean2.1066666666666674


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.4233843075749464, "good_angle": -2.4638861138891506, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 4.66666666666667}, "ep001": {"nsteps": 386, "reward": -3.1166537022507637, "good_angle": 4.244101413994013, "survival_time": 12.833333333333298, "traveled_tiles": 4, "valid_direction": 2.599999999999997}, "ep002": {"nsteps": 104, "reward": -11.388280546435944, "good_angle": -1.3747431511385066, "survival_time": 3.466666666666664, "traveled_tiles": 1, "valid_direction": 2.033333333333335}, "ep003": {"nsteps": 64, "reward": -18.35143273510039, "good_angle": -1.0831424031320938, "survival_time": 1.700000000000002, "traveled_tiles": 2, "valid_direction": 1.2333333333333354}, "ep004": {"nsteps": 86, "reward": -14.024341815432836, "good_angle": 0.5198142022417283, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max4.244101413994013
good_angle_median-1.0831424031320938
good_angle_min-2.4638861138891506
reward_max-0.4233843075749464
reward_mean-9.460818621358976
reward_median-11.388280546435944
reward_min-18.35143273510039
survival_time_max16.666666666666654
survival_time_median3.466666666666664
survival_time_min1.700000000000002
traveled_tiles_max5
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max4.66666666666667
valid_direction_median2.033333333333335
valid_direction_min0
No reset possible
14582Andy SerTensorflow templateaido1_LF1_r2-v3step1-simulationsuccessnonutonomy-P50-300370:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
14081Bhairav MehtaROS-based Lane Followingaido1_LF1-v3step1-simulationfailedyesnutonomy-P50-300370:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
line_detector
ROS path [0]=/opt/ros/kinetic/share/ros
ROS path [1]=/workspace/catkin_ws/src
ROS path [2]=/opt/ros/kinetic/share
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
13980Bhairav MehtaROS-based Lane Following, v2aido1_LF1_r2-v3step2-scoringsuccessnonutonomy-P50-300370:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean5.226666666666661
good_angle_mean-2.6142739446555794
valid_direction_mean2.1066666666666674


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7270584515869268, "good_angle": 0.6113363245679542, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.833333333333329}, "ep001": {"nsteps": 129, "reward": -8.941110750270445, "good_angle": -1.2185749713141856, "survival_time": 4.266666666666661, "traveled_tiles": 3, "valid_direction": 2.899999999999996}, "ep002": {"nsteps": 500, "reward": -2.131006907548755, "good_angle": -6.25411895361178, "survival_time": 4.233333333333328, "traveled_tiles": 3, "valid_direction": 0.4333333333333349}, "ep003": {"nsteps": 384, "reward": -3.4656277570605503, "good_angle": 5.62131017050555, "survival_time": 0.49999999999999994, "traveled_tiles": 3, "valid_direction": -3.166666666666657}, "ep004": {"nsteps": 500, "reward": -0.6495034841937013, "good_angle": -11.831322293425435, "survival_time": 0.4666666666666666, "traveled_tiles": 3, "valid_direction": -3.4666666666666632}}
good_angle_max5.62131017050555
good_angle_median-1.2185749713141856
good_angle_min-11.831322293425435
reward_max-0.6495034841937013
reward_mean-3.182861470132076
reward_median-2.131006907548755
reward_min-8.941110750270445
survival_time_max16.666666666666654
survival_time_median4.233333333333328
survival_time_min0.4666666666666666
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_min2
valid_direction_max13.833333333333329
valid_direction_median0.4333333333333349
valid_direction_min-3.4666666666666632
No reset possible
13779Bhairav MehtaTemplate for ROS Submissionaido1_LF1-v3step2-scoringsuccessyesnutonomy-P50-300370:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-22.143782956067483


other stats
ep000
details{"nsteps": 20, "reward": -50.697109405696395}
ep001
details{"nsteps": 40, "reward": -27.076787041849457}
ep002
details{"nsteps": 115, "reward": -12.875315831018533}
ep003
details{"nsteps": 128, "reward": -9.414432012716134}
ep004
details{"nsteps": 120, "reward": -10.655270489056903}
No reset possible
13377Bhairav MehtaROS-based Lane Followingaido1_LF1_r2-v3step1-simulationfailednonutonomy-P50-300370:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 475, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible