Submission 13306

Submission

13306

Competing

yes

Challenge

aido5-LFP-real-validation

User

Márton Tim 🇭🇺

Date submitted

2020-12-11 19:29:49+00:00

Last status update

2021-12-04 21:03:41+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

eval0: 60963 eval0-videos: 61458 eval0-visualize: 61460 eval1: 60976 eval1-videos: 61459 eval1-visualize: 61457 eval2: 60983 eval2-videos: 61453 eval2-visualize: 61451

User label

test_submit

Admin priority

Blessing

n/a

User priority

61460

Click the images to see detailed statistics about the episode.

sync

tmp

visualization

61459

robot

watchtower

61458

robot

watchtower

61457

Click the images to see detailed statistics about the episode.

sync

tmp

visualization

61453

robot

watchtower

61451

Click the images to see detailed statistics about the episode.

sync

tmp

visualization

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

61460

eval0-visualize

success

yes

2020-12-12 14:08:55+00:00

2020-12-12 14:10:27+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec	0.08145621207242604
survival_time	3.429880142211914
deviation-center-line	0.491877344900264
in-drivable-lane	0.0

other stats

deviation-heading	1.1112631577782264
driven_any	0.09804600126281392
driven_lanedir	0.08145621207242604
visualized-eval0-passed	1

No reset possible

61459

eval1-videos

success

yes

2020-12-12 14:08:53+00:00

2020-12-12 14:11:39+00:00

0:02:46

all ok, 8 bags proce [...]

all ok, 8 bags processed

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61458

eval0-videos

success

yes

2020-12-12 14:08:25+00:00

2020-12-12 14:10:57+00:00

0:02:32

all ok, 8 bags proce [...]

all ok, 8 bags processed

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61457

eval1-visualize

success

yes

2020-12-12 14:07:24+00:00

2020-12-12 14:08:48+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec	0.3431278612485853
survival_time	5.93418025970459
deviation-center-line	0.2564553856822106
in-drivable-lane	3.4328765869140625

other stats

deviation-heading	0.2690108937627419
driven_any	0.5025292818337489
driven_lanedir	0.3431278612485853
visualized-eval1-passed	1

No reset possible

61453

eval2-videos

success

yes

2020-12-12 14:05:17+00:00

2020-12-12 14:06:43+00:00

0:01:26

all ok, 8 bags proce [...]

all ok, 8 bags processed

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61451

eval2-visualize

success

yes

2020-12-12 14:04:47+00:00

2020-12-12 14:07:06+00:00

0:02:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec	0.23387222230022875
survival_time	4.014149188995361
deviation-center-line	0.25706490193900877
in-drivable-lane	0.0

other stats

deviation-heading	0.20968088550139355
driven_any	0.23447803362005917
driven_lanedir	0.23387222230022875
visualized-eval2-passed	1

No reset possible

61328

eval2-videos

success

2020-12-12 12:43:44+00:00

2020-12-12 12:45:58+00:00

0:02:14

all ok, 8 bags proce [...]

all ok, 8 bags processed

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61302

eval0-visualize

success

2020-12-12 11:17:24+00:00

2020-12-12 11:18:38+00:00

0:01:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61300

eval1-visualize

success

2020-12-12 11:15:55+00:00

2020-12-12 11:17:17+00:00

0:01:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61299

eval2-visualize

success

2020-12-12 11:15:19+00:00

2020-12-12 11:17:36+00:00

0:02:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61297

eval1-visualize

success

2020-12-12 11:14:11+00:00

2020-12-12 11:15:29+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61053

eval0-visualize

error

2020-12-12 09:54:22+00:00

2020-12-12 09:55:23+00:00

0:01:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
    self.read_next_frame()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
    rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
OSError: obtaining file position failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 216, in evaluate_robotarium_log
    make_video_join(out_together, out_robot, out_pair)
  File "/project/evaluate_robotarium_log.py", line 402, in make_video_join
    pg('pair_couple', params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'mplayer'.
- B:MPlayer:mplayer(in:/;out:video) 140627394164288
- M:pair_couple:cmdline(in:/;out:/) 140627394163136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
>     self.read_next_frame()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
>     rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
> OSError: obtaining file position failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61052

eval0-visualize

error

2020-12-12 09:52:54+00:00

2020-12-12 09:53:57+00:00

0:01:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
    self.read_next_frame()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
    rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
OSError: obtaining file position failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 216, in evaluate_robotarium_log
    make_video_join(out_together, out_robot, out_pair)
  File "/project/evaluate_robotarium_log.py", line 402, in make_video_join
    pg('pair_couple', params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'mplayer'.
- B:MPlayer:mplayer(in:/;out:video) 139747255674864
- M:pair_couple:cmdline(in:/;out:/) 139747255673472
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
>     self.read_next_frame()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
>     rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
> OSError: obtaining file position failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61050

eval2-visualize

error

2020-12-12 09:51:32+00:00

2020-12-12 09:52:42+00:00

0:01:10

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
    self.read_next_frame()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
    rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
OSError: obtaining file position failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 216, in evaluate_robotarium_log
    make_video_join(out_together, out_robot, out_pair)
  File "/project/evaluate_robotarium_log.py", line 402, in make_video_join
    pg('pair_couple', params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'mplayer'.
- B:MPlayer:mplayer(in:/;out:video) 139642758524880
- M:pair_couple:cmdline(in:/;out:/) 139642758523776
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
>     self.read_next_frame()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
>     rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
> OSError: obtaining file position failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

61024

eval1-visualize

error

2020-12-12 09:39:37+00:00

2020-12-12 09:40:48+00:00

0:01:11

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
    self.read_next_frame()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
    rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
OSError: obtaining file position failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 216, in evaluate_robotarium_log
    make_video_join(out_together, out_robot, out_pair)
  File "/project/evaluate_robotarium_log.py", line 402, in make_video_join
    pg('pair_couple', params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'mplayer'.
- B:MPlayer:mplayer(in:/;out:video) 140201265669936
- M:pair_couple:cmdline(in:/;out:/) 140201265670416
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
>     self.read_next_frame()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
>     rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
> OSError: obtaining file position failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60994

eval2-videos

success

2020-12-12 07:18:17+00:00

2020-12-12 07:19:50+00:00

0:01:33

all ok, 8 bags proce [...]

all ok, 8 bags processed

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60991

eval2-videos

success

2020-12-12 07:16:38+00:00

2020-12-12 07:18:10+00:00

0:01:32

all ok, 8 bags proce [...]

all ok, 8 bags processed

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60990

eval2-visualize

success

2020-12-12 07:14:32+00:00

2020-12-12 07:16:18+00:00

0:01:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60987

eval1-visualize

success

2020-12-12 07:07:52+00:00

2020-12-12 07:09:07+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60985

eval1-visualize

success

2020-12-12 07:06:07+00:00

2020-12-12 07:07:25+00:00

0:01:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60984

eval1-videos

success

2020-12-12 07:04:03+00:00

2020-12-12 07:05:52+00:00

0:01:49

all ok, 8 bags proce [...]

all ok, 8 bags processed

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60983

eval2

success

yes

2020-12-12 07:02:39+00:00

2020-12-12 07:12:11+00:00

0:09:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60976

eval1

success

yes

2020-12-12 06:51:49+00:00

2020-12-12 07:00:39+00:00

0:08:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60966

eval0-videos

success

2020-12-12 04:54:57+00:00

2020-12-12 04:56:50+00:00

0:01:53

all ok, 8 bags proce [...]

all ok, 8 bags processed

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60965

eval0-visualize

success

2020-12-12 04:52:46+00:00

2020-12-12 04:54:33+00:00

0:01:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60963

eval0

success

yes

2020-12-12 04:26:34+00:00

2020-12-12 04:51:30+00:00

0:24:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible