Fixing wording on leaky-relu

boazcogan · boazcogan · commit 4def59cc1384 · 2021-04-20T22:57:55.000-05:00
diff --git a/book/approaches/deep/building_blocks.md b/book/approaches/deep/building_blocks.md
@@ -508,7 +508,8 @@ A plot of the PReLU activation function.
 Two related activation functions to ReLUs are the `Leaky ReLU` and `PReLU`.
 
 The Leaky ReLU is similar to the regular ReLU, but instead of 
-the output being $0.0$ below $x=0.0$ it is ever so slightly above $0.0$:
+the output being $0.0$ below $x=0.0$ it is weighted ever so slightly above $0.0$ 
+so that smaller updates will be made:
 
 ![leaky_relu_eq](../../images/deep_approaches/leaky_relu_eq.svg)
 
@@ -794,4 +795,4 @@ to make whole networks. We'll see how that's done on the next page.
 
 
 [^fn1]: Although we won't cover Wavenet in detail in this tutorial, it has been
-  used for music source separation in this paper: {cite}`lluis2019end`.
+  used for music source separation in this paper: {cite}`lluis2019end`.
