Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
S
seminar-breakout
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Analytics
Analytics
CI / CD
Repository
Value Stream
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Shashank Suhas
seminar-breakout
Commits
b6a4f429
Commit
b6a4f429
authored
Apr 04, 2017
by
Yuxin Wu
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
a correct size() for JoinData. (#217)
parent
502c461d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
3 deletions
+4
-3
tensorpack/dataflow/common.py
tensorpack/dataflow/common.py
+4
-3
No files found.
tensorpack/dataflow/common.py
View file @
b6a4f429
...
...
@@ -406,7 +406,8 @@ class JoinData(DataFlow):
"""
Args:
df_lists (list): a list of DataFlow.
All must have the same ``size()``, or don't have size.
When these dataflows have different sizes, JoinData will stop when any
of them is exhausted.
"""
self
.
df_lists
=
df_lists
...
...
@@ -423,7 +424,7 @@ class JoinData(DataFlow):
d
.
reset_state
()
def
size
(
self
):
return
self
.
df_lists
[
0
]
.
size
(
)
return
min
([
k
.
size
()
for
k
in
self
.
df_lists
]
)
def
get_data
(
self
):
itrs
=
[
k
.
get_data
()
for
k
in
self
.
df_lists
]
...
...
@@ -433,7 +434,7 @@ class JoinData(DataFlow):
for
itr
in
itrs
:
dp
.
extend
(
next
(
itr
))
yield
dp
except
StopIteration
:
except
StopIteration
:
# some of them are exhausted
pass
finally
:
for
itr
in
itrs
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment