Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
S
seminar-breakout
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Analytics
Analytics
CI / CD
Repository
Value Stream
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Shashank Suhas
seminar-breakout
Commits
d8da92d6
Commit
d8da92d6
authored
Nov 14, 2017
by
Yuxin Wu
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
update docs
parent
2fa49895
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
6 deletions
+5
-6
docs/tutorial/input-source.md
docs/tutorial/input-source.md
+5
-6
No files found.
docs/tutorial/input-source.md
View file @
d8da92d6
...
...
@@ -63,20 +63,19 @@ Both are supported in tensorpack, while we recommend using Python.
### TensorFlow Reader: Cons
The disadvantage of TF reader is obvious and it's huge: it's __too complicated__.
Reading data is a
more complicated and less
structured job than running the model.
Reading data is a
complicated and badly-
structured job than running the model.
You need to handle different data format, handle corner cases in noisy data,
which all require
logical operations, condition operations, loops, etc
. These operations
are __naturally not suitable__ for a
graph computation framework
.
which all require
condition operations, loops, sometimes even exception handling
. These operations
are __naturally not suitable__ for a
symbolic graph
.
Let's take a look at what users are asking for:
*
[
Different ways to pad your data
](
https://github.com/tensorflow/tensorflow/issues/13969
)
*
Different ways to
[
pad data
](
https://github.com/tensorflow/tensorflow/issues/13969
)
,
[
shuffle data
](
https://github.com/tensorflow/tensorflow/issues/14518
)
*
[
Handle none values in data
](
https://github.com/tensorflow/tensorflow/issues/13865
)
*
[
Handle dataset that's not a multiple of batch size
](
https://github.com/tensorflow/tensorflow/issues/13745
)
*
[
Different levels of determinism
](
https://github.com/tensorflow/tensorflow/issues/13932
)
*
[
Sort/skip some data
](
https://github.com/tensorflow/tensorflow/issues/14250
)
*
[
Take variable-length np array
](
https://github.com/tensorflow/tensorflow/issues/13018
)
To support these features which could've been done with 3 lines of code in Python, you need either a new TF
To support
all
these features which could've been done with 3 lines of code in Python, you need either a new TF
API, or ask
[
Dataset.from_generator
](
https://www.tensorflow.org/versions/r1.4/api_docs/python/tf/contrib/data/Dataset#from_generator
)
(i.e. Python again) to the rescue.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment