Skip to content

S
seminar-breakout
Commit e1bb7c2f authored by Yuxin Wu's avatar Yuxin Wu
Browse files
Options

fix BN on FC layer

parent 3e0a861e
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
tensorpack/models/batch_norm.py
View file @ e1bb7c2f
...@@ -181,6 +181,9 @@ def BatchNorm(x, use_local_stat=None, decay=0.9, epsilon=1e-5): ...@@ -181,6 +181,9 @@ def BatchNorm(x, use_local_stat=None, decay=0.9, epsilon=1e-5):
xn = tf.nn.batch_normalization( xn = tf.nn.batch_normalization(
x, moving_mean, moving_var, beta, gamma, epsilon) x, moving_mean, moving_var, beta, gamma, epsilon)
if len(shape) == 2:
xn = tf.squeeze(xn, [1, 2])
# TODO for other towers, maybe can make it depend some op later # TODO for other towers, maybe can make it depend some op later
# TODO update it later (similar to slim) might be faster? # TODO update it later (similar to slim) might be faster?
if ctx.is_main_training_tower: if ctx.is_main_training_tower:
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment