Duckietown Challenges Home Challenges Submissions

Submission 28732

Submission28732
Competingyes
Challengelx22-BV1
Useruser9667
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 199265 sim-1of5: 199258 sim-2of5: 199253 sim-3of5: 199267 sim-4of5: 199257
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

199267

Click the images to see detailed statistics about the episode.

d50

199265

Click the images to see detailed statistics about the episode.

d30

199258

Click the images to see detailed statistics about the episode.

d45

199257

Click the images to see detailed statistics about the episode.

d60

199253

Click the images to see detailed statistics about the episode.

d45

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
199267sim-3of5successyes0:04:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.468560993456901


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.468560993456901
distance-from-start_median5.468560993456901
distance-from-start_min5.468560993456901
driven_any_max5.582270207385671
driven_any_mean5.582270207385671
driven_any_median5.582270207385671
driven_any_min5.582270207385671
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max37.79999999999999
in-drivable-lane_mean37.79999999999999
in-drivable-lane_median37.79999999999999
in-drivable-lane_min37.79999999999999
per-episodes
details{"d50-ego0": {"driven_any": 5.582270207385671, "survival_time": 37.79999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 37.79999999999999, "deviation-heading": 0.0, "distance-from-start": 5.468560993456901, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max37.79999999999999
survival_time_mean37.79999999999999
survival_time_median37.79999999999999
survival_time_min37.79999999999999
No reset possible
199266sim-3of5successyes0:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199265sim-0of5successyes0:19:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.024710625202399


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.024710625202399
distance-from-start_median6.024710625202399
distance-from-start_min6.024710625202399
driven_any_max6.1646027468604165
driven_any_mean6.1646027468604165
driven_any_median6.1646027468604165
driven_any_min6.1646027468604165
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max41.44999999999978
in-drivable-lane_mean41.44999999999978
in-drivable-lane_median41.44999999999978
in-drivable-lane_min41.44999999999978
per-episodes
details{"d30-ego0": {"driven_any": 6.1646027468604165, "survival_time": 41.44999999999978, "driven_lanedir": 0.0, "in-drivable-lane": 41.44999999999978, "deviation-heading": 0.0, "distance-from-start": 6.024710625202399, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max41.44999999999978
survival_time_mean41.44999999999978
survival_time_median41.44999999999978
survival_time_min41.44999999999978
No reset possible
199264sim-0of5successyes0:16:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199263sim-3of5successyes0:18:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199262sim-0of5successyes0:05:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199261sim-3of5timeoutyes0:02:10
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199260sim-0of5host-erroryes0:07:11
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-01-6.3.0-job199260-660598, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-01-6.3.0-job199260-660598', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199259sim-3of5host-erroryes0:07:15
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-02-6.3.0-job199259-772148, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-02-6.3.0-job199259-772148', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199258sim-1of5successyes0:05:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.6146788829339656


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.6146788829339656
distance-from-start_median5.6146788829339656
distance-from-start_min5.6146788829339656
driven_any_max5.9529535760180625
driven_any_mean5.9529535760180625
driven_any_median5.9529535760180625
driven_any_min5.9529535760180625
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max39.3999999999999
in-drivable-lane_mean39.3999999999999
in-drivable-lane_median39.3999999999999
in-drivable-lane_min39.3999999999999
per-episodes
details{"d45-ego0": {"driven_any": 5.9529535760180625, "survival_time": 39.3999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 39.3999999999999, "deviation-heading": 0.0, "distance-from-start": 5.6146788829339656, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max39.3999999999999
survival_time_mean39.3999999999999
survival_time_median39.3999999999999
survival_time_min39.3999999999999
No reset possible
199257sim-4of5successyes0:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.637138214118402


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.637138214118402
distance-from-start_median4.637138214118402
distance-from-start_min4.637138214118402
driven_any_max4.6897311528827315
driven_any_mean4.6897311528827315
driven_any_median4.6897311528827315
driven_any_min4.6897311528827315
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max32.00000000000032
in-drivable-lane_mean32.00000000000032
in-drivable-lane_median32.00000000000032
in-drivable-lane_min32.00000000000032
per-episodes
details{"d60-ego0": {"driven_any": 4.6897311528827315, "survival_time": 32.00000000000032, "driven_lanedir": 0.0, "in-drivable-lane": 32.00000000000032, "deviation-heading": 0.0, "distance-from-start": 4.637138214118402, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max32.00000000000032
survival_time_mean32.00000000000032
survival_time_median32.00000000000032
survival_time_min32.00000000000032
No reset possible
199256sim-0of5successyes0:24:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199255sim-1of5successyes0:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199254sim-1of5successyes0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199253sim-2of5successyes0:08:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.7198480835532584


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.7198480835532584
distance-from-start_median2.7198480835532584
distance-from-start_min2.7198480835532584
driven_any_max2.8322175522341926
driven_any_mean2.8322175522341926
driven_any_median2.8322175522341926
driven_any_min2.8322175522341926
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max19.000000000000135
in-drivable-lane_mean19.000000000000135
in-drivable-lane_median19.000000000000135
in-drivable-lane_min19.000000000000135
per-episodes
details{"d45-ego0": {"driven_any": 2.8322175522341926, "survival_time": 19.000000000000135, "driven_lanedir": 0.0, "in-drivable-lane": 19.000000000000135, "deviation-heading": 0.0, "distance-from-start": 2.7198480835532584, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max19.000000000000135
survival_time_mean19.000000000000135
survival_time_median19.000000000000135
survival_time_min19.000000000000135
No reset possible
199252sim-0of5successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199251sim-4of5successyes0:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199250sim-3of5successyes0:28:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199249sim-1of5abortedyes0:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199248sim-4of5abortedyes0:06:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199247sim-3of5abortedyes0:10:18
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-03-6.3.0-job199247-655859, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-03-6.3.0-job199247-655859', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199246sim-2of5abortedyes0:32:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199245sim-4of5abortedyes0:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199244sim-2of5abortedyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199243sim-3of5abortedyes0:04:53
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-03-6.3.0-job199243-52992, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-03-6.3.0-job199243-52992', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199242sim-2of5abortedyes0:00:17
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199241sim-4of5abortedyes0:07:38
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-02-6.3.0-job199241-284441, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-02-6.3.0-job199241-284441', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199240sim-3of5abortedyes0:07:42
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-05-6.3.0-job199240-577667, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-05-6.3.0-job199240-577667', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199239sim-1of5abortedyes0:09:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 325, in read_reply
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout of 120 violated while waiting for None.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199238sim-2of5abortedyes0:09:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 325, in read_reply
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout of 120 violated while waiting for None.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199237sim-2of5abortedyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199236sim-4of5abortedyes0:02:26
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-02-6.3.0-job199236-534891, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-02-6.3.0-job199236-534891', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199235sim-1of5abortedyes0:02:26
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-05-6.3.0-job199235-118612, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-05-6.3.0-job199235-118612', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199234sim-0of5abortedyes0:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199233sim-3of5abortedyes0:02:50
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, Archimede-prod-b-04-6.3.0-job199233-499203, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'Archimede-prod-b-04-6.3.0-job199233-499203', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible