mindspore.mint.nn.functional.batch_normÔÉĀ
- mindspore.mint.nn.functional.batch_norm(input, running_mean, running_var, weight=None, bias=None, vpn梯子 training=False, momentum=0.1, vpn梯子 vpn free 免费 eps=1e-5)[śļźšĽ£Á†Ā]ÔÉĀ
ŚĮĻŤĺďŚÖ•śēįśćģŤŅõŤ°ĆśČĻťáŹŚĹ횳ČĆĖŚíĆśõīśĖįŚŹāśēį„Äā
śČĻťáŹŚĹ횳ČĆĖŚĻŅś≥õŚļĒÁĒ®šļéŚć∑ÁßĮÁ•ěÁĽŹÁĹĎÁĽúšł≠„Äāś≠§ŤŅźÁģóŚĮĻŤĺďŚÖ•ŚļĒÁĒ®ŚĹ횳ČĆĖԾƝĀŅŚÖćŚÜ֝ɮŚćŹŚŹėťáŹŚĀŹÁ߼ԾƍĮ¶ŤßĀŤģļśĖá Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift „ÄāšĹŅÁĒ®mini-batchśēįśćģŚíĆŚ≠¶šĻ†ŚŹāśēįŤŅõŤ°ĆŤģ≠ÁĽÉԾƌ≠¶šĻ†ÁöĄŚŹāśēįŤßĀŚ¶āšłčŚÖ¨ŚľŹšł≠ÔľĆ
\[y = \frac{x - \mathrm{mean}}{\sqrt{\mathrm{variance} + \epsilon}} * \gamma + \beta\]ŚÖ∂šł≠ÔľĆ \(\gamma\) šłļ weightÔľĆ vpn梯子 免费 \(\beta\) šłļ biasÔľĆ \(\epsilon\) šłļ epsÔľĆ \(\mathrm{mean}\) šłļ \(x\) ÁöĄŚĚáŚÄľÔľĆ \(\mathrm{variance}\) šłļ \(x\) ÁöĄśĖĻŚ∑ģ„Äā
- ŚŹāśēįÔľö
input (Tensor) - śēįśćģŤĺďŚÖ•ÔľĆshapešłļ vpn free vpn永久免费梯子 \((N, C, *)\) ÁöĄTensorԾƌÖ∂šł≠ \(*\) Ť°®Á§ļšĽĽśĄŹÁöĄťôĄŚä†ÁĽīŚļ¶„ÄāśĒĮśĆĀśēįśćģÁĪĽŚěčšłļbfloat16„ÄĀfloat16śąĖfloat32„Äā
running_mean (Tensor) - vpn永久免费梯子 shapešłļ \((C,)\) ԾƜēįśćģÁĪĽŚěčšłļbfloat16„ÄĀfloat16śąĖfloat32„Äā
running_var (Tensor) - shapešłļ \((C,)\) ԾƜēįśćģÁĪĽŚěčšłļbfloat16„ÄĀfloat16śąĖfloat32„Äā
weight (Tensor, ŚŹĮťÄČ) - shapešłļ \((C,)\) ԾƜēįśćģÁĪĽŚěčšłļbfloat16„ÄĀfloat16śąĖfloat32„ÄāťĽėŤģ§ŚÄľÔľö
None„ÄāŚĹď weight šłļNoneśó∂ԾƌąĚŚßčŚĆĖšłļ1„Äābias (Tensor, ŚŹĮťÄČ) - shapešłļ \((C,)\) ԾƜēįśćģÁĪĽŚěčšłļbfloat16„ÄĀfloat16śąĖfloat32„ÄāťĽėŤģ§ŚÄľÔľö
None„ÄāŚĹď bias šłļNoneśó∂ԾƌąĚŚßčŚĆĖšłļ0„Äātraining (boolԾƌŹĮťÄČ) - ڶāśěú training šłļ
TrueÔľĆ running_mean ŚíĆ running_var šľöŚú®Ťģ≠ÁĽÉŤŅáÁ®čšł≠ŤŅõŤ°ĆŤģ°Áģó„Äā Ś¶āśěú training šłļFalseԾƌģÉšĽ¨šľöŚú®śé®ÁźÜťė∂śģĶšĽécheckpointšł≠Śä†ŤĹĹ„ÄāťĽėŤģ§ŚÄľÔľö vpn freeFalse„Äāmomentum (float, ŚŹĮťÄČ) - ÁĒ®šļéŤģ°Áģó running_mean ŚíĆ running_var śĽĎŚä®ŚĻ≥ŚĚáÁöĄŚä®ťáŹÁ≥Ľśēį„ÄāÔľąšĺ茶ā \(new\_running\_mean = (1 - momentum) * running\_mean vpn梯子 + momentum * current\_mean\)ԾȄÄāťĽėŤģ§ŚÄľÔľö
0.1„Äāeps vpn梯子 免费 (float, ŚŹĮťÄČ) - ś∑ĽŚä†ŚąįŚąÜśĮćšłäÁöĄŚÄľÔľĆšĽ•Á°ģšŅĚśēįŚÄľÁ®≥ŚģöśÄß„ÄāťĽėŤģ§ŚÄľÔľö
1e-5„Äā
- ŤŅĒŚõěÔľö
TensorԾƜēįśćģÁĪĽŚěčšłéshapeŚ§ßŚįŹšłé input vpn梯子 vpn永久免费梯子 ÁõłŚźĆԾƌÖ∂šł≠ÔľĆshapeŚ§ßŚįŹšłļ \((N, vpn梯子 免费 C, *)\) „Äā
- ŚľāŚłłÔľö
TypeError - training šłćśėĮbool„Äā
TypeError - eps śąĖ momentum ÁöĄśēįśćģÁĪĽŚěčšłćśėĮfloat„Äā
TypeError - input„ÄĀ weight 免费的vpn梯子 „ÄĀ bias „ÄĀ running_mean śąĖ running_var šłćśėĮTensor„Äā
- śĒĮśĆĀŚĻ≥ŚŹįÔľö
Ascend
ś†∑šĺčÔľö
>>> import mindspore >>> from mindspore import Tensor, mint >>> input_x = Tensor([[1.0, 免费的vpn梯子 vpn梯子 免费的vpn梯子 免费 2.0], [3.0, 4.0]], mindspore.float32) >>> running_mean = Tensor([0.5, 1.5], mindspore.float32) >>> running_var = Tensor([0.1, 0.2], mindspore.float32) >>> weight = Tensor([2.0, 2.0], mindspore.float32) >>> bias = Tensor([-1.0, -1.0], mindspore.float32) >>> output = mint.nn.functional.batch_norm(input_x, running_mean, running_var, weight, bias) >>> print(output) [[ 2.1621194 1.2360122] [14.810596 10.180061 ]]