Gradient clipping: what are good values to clip at and why ...

In the context of deep neural networks, RNNs, and LSTMs, what are good values to use for gradient clipping? Is there any rationale for choosing that specific value? And does the answer depend on network type?

GAla Smith & AI Research Desk·1h ago·1 min read·11 views·AI-Generated
Share:
Source: reddit.comSingle Source

In the context of deep neural networks, RNNs, and LSTMs, what are good values to use for gradient clipping? Is there any rationale for choosing that specific value? And does the answer depend on network type?

Source: Discussion on r/MachineLearning

Enjoyed this article?
Share:

Related Articles

More in Products & Launches

View all