Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
S
seminar-breakout
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Analytics
Analytics
CI / CD
Repository
Value Stream
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Shashank Suhas
seminar-breakout
Commits
05b18a47
Commit
05b18a47
authored
Dec 21, 2016
by
Yuxin Wu
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
catch error in prefetch
parent
20973118
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
5 deletions
+10
-5
tensorpack/dataflow/prefetch.py
tensorpack/dataflow/prefetch.py
+10
-5
No files found.
tensorpack/dataflow/prefetch.py
View file @
05b18a47
...
...
@@ -149,11 +149,16 @@ class PrefetchDataZMQ(ProxyDataFlow):
start_proc_mask_signal
(
self
.
procs
)
def
get_data
(
self
):
for
k
in
itertools
.
count
():
if
self
.
_size
>
0
and
k
>=
self
.
_size
:
break
dp
=
loads
(
self
.
socket
.
recv
(
copy
=
False
)
.
bytes
)
yield
dp
try
:
for
k
in
itertools
.
count
():
if
self
.
_size
>
0
and
k
>=
self
.
_size
:
break
dp
=
loads
(
self
.
socket
.
recv
(
copy
=
False
)
.
bytes
)
yield
dp
except
zmq
.
ContextTerminated
:
logger
.
info
(
"ContextTerminated in Master Prefetch Process"
)
except
:
raise
def
reset_state
(
self
):
# do nothing. all ds are reset once and only once in spawned processes
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment