Beware that, when fighting monsters, you yourself do not become a monster… for when you gaze long into the abyss. The abyss gazes also into you, Friedrich W. Nietzsche
Definition. A differential equation is an equation that involves one or more dependent variables, their derivatives with respect to one or more independent variables, and the independent variables themselves, e.g., $\frac{dy}{dx} = 3x +5y, y’ + y = 4xcos(2x), \frac{dy}{dx} = x^2y+y, etc.$
It involves (e.g., $\frac{dy}{dx} = 3x +5y$):
Definition. A first-order linear ordinary differential equation is an ordinary differential equation (ODE) involving an unknown function y(x), its first derivative y′, and functions of the independent variable x, which can be written in the general form:: a(x)y' + b(x)y = c(x) where:
These equations are termed “linear” because the unknown function y and its derivative y’ appear to the first power and are not multiplied together or composed in any nonlinear way.
If the function c(x)=0 for all x in the interval of interest, the equation simplifies to: a(x)y’ + b(x)y = 0. Such an equation is called a homogeneous linear differential equation.
The Existence and Uniqueness Theorem provides crucial insight into the behavior of solutions to first-order differential equations ODEs. It states that if:
Then, the differential equation y' = f(x, y) has a unique solution to the initial value problem through the point (x0, y0), meaning that it satisfies the initial condition y(x0) = y0.
This theorem ensures that under these conditions, the solution exists and is unique near x = x0.
The Laplace Transform of a function f(t), where t ≥ 0, is defined as $\mathcal{L}(f(t)) = \int_{0}^{∞} f(t)e^{-st}dt = F(s)$.
One of the most important properties of the Laplace Transform is linearity, which states: $\mathcal{L}(af(t)+bg(t)) = a\mathcal{L}(f(t))+b\mathcal{L}(g(t))$
Function | Laplace Transform |
---|---|
u(t) | $\mathcal{L}(u(t)) = \frac{1}{s}, s > 0$ |
$e^{at}$ | $\frac{1}{s - a}, s > a$ |
$e^{(a + bi)t}$ | $\mathcal{L}(e^{(a + bi)t}) = \frac{1}{s - (a + bi)}, s > a$ |
$\cos(\omega t)$ | $\mathcal{L}(\cos(\omega t)) = \frac{s}{s^2 + \omega^2}, s > 0$ |
$\sin(\omega t)$ | $\mathcal{L}(\sin(\omega t)) = \frac{\omega}{s^2 + \omega^2}, s > 0$ |
$t^n$ | $\mathcal{L}(t^n) = \frac{n!}{s^{n+1}}, s > 0$ |
$u(t-a)$ | $\mathcal{L}(u(t-a)) = \frac{e^{-as}}{s}, s > 0$ |
$\delta(t-a)$ | $\mathcal{L}(\delta(t-a)) = e^{-as}, a \geq 0$ |
$\frac{1}{t}$ | $\mathcal{L}\left(\frac{1}{t}\right) = \text{not defined}$ |
$e^{-bt} \cos(\omega t)$ | $\mathcal{L}(e^{-bt} \cos(\omega t)) = \frac{s + b}{(s + b)^2 + \omega^2}, s > -b$ |
$e^{-bt} \sin(\omega t)$ | $\mathcal{L}(e^{-bt} \sin(\omega t)) = \frac{\omega}{(s + b)^2 + \omega^2}, s > -b$ |
$e^{at}f(t)$ | $\mathcal{L}(e^{at}f(t)) = F(s-a)$ |
The last entry illustrates the Exponential Shift Theorem, indicating that multiplying a function by an exponential term eat shifts its Laplace Transform.
Additionally, the Laplace Transforms of derivatives are given by: $\mathcal{L}(f’(t)) = sF(s)-f(0), \mathcal{L}(f’’(t)) = s^2F(s)-sf(0)-f’(0)$
The Laplace transform of f(at) is given by: $\mathcal{L}(f(at)) = \int_{0}^{∞} e^{-st}f(at)dt =$ We perform a change of variables, letting u = at. Then: du = adt. When t = 0, u = 0. When t = ∞, u = ∞.
Substituting these into the integral, we get: $\int_{0}^{∞} e^{-s\frac{u}{a}}f(u)\frac{du}{a} = \frac{1}{a} \int_{0}^{∞} e^{-\frac{s}{a}u}f(u)du$ =[Recognizing that the integral on the right is F(s) evaluated at s⁄a] $\frac{1}{a}F(\frac{s}{a})$
$\mathcal{L}(sin(bt)) =[\text{To find the Laplace transform of sin(bt), we use the result from the previous section } \mathcal{L}(f(at)) = \frac{1}{a}F(\frac{s}{a})] \frac{1}{b}F(\frac{s}{b}) = [sin(t) \leadsto \frac{1}{s^2+1}] \frac{1}{b}·\frac{1}{(\frac{s}{b})^2+1} = \frac{1}{b}·\frac{b^2}{s^2+b^2} = \frac{b}{s^2+b^2}$
We aim to calculate $\mathcal{L}(\frac{f(t)}{t}) = \int_{0}^{∞} e^{-st}\frac{f(t)}{t}dt$
We can express $\frac{e^{-st}}{t}$ as an integral over u: $\int_{s}^{∞} e^{-ut}du = \frac{1}{-t}e^{-ut}\bigg|_{s}^{∞} = 0 -(\frac{1}{-t})e^{-st} = \frac{e^{-st}}{t}$
$\mathcal{L}(f(t)) = \int_{0}^{∞} e^{-st}\frac{f(t)}{t}dt = \int_{0}^{∞} (\int_{s}^{∞} e^{-ut}du)f(t)dt = [\text{Interchange the Order of Integration}] \int_{s}^{∞} (\int_{0}^{∞} e^{-ut}f(t)dt)du = \int_{s}^{∞} F(u)du$
We know that $\mathcal{L}(sin(t)) = \frac{1}{s^2+1} =[\text{Using a dummy variable}] \frac{1}{u^2+1}$, and from the previous exercise $\mathcal{L}(\frac{f(t)}{t}) = \int_{s}^{∞} F(u)du$
$\mathcal{L}(\frac{sin(t)}{t}) = \int_{s}^{∞} \frac{1}{u^2+1}du = tan^{-1}(u)\bigg|_{s}^{∞} = tan^{-1}(∞)-tan^{-1}(s) = \frac{π}{2}-tan^{-1}(s)$
Step 1: Partial Fraction Decomposition. Express the rational function as a sum of simpler fractions: $\frac{1}{s(s+3)} =[\text{Using fractions decomposition}] = \frac{A}{s} + \frac{B}{s+3}$
Now, we need to find A and B. To do this, we rewrite the expression: $\frac{1}{s(s+3)} = \frac{A(s+3)+Bs}{s(s+3)} = \frac{As + 3A + Bs}{s(s+3)} =[\text{Grouping terms}] \frac{(A + B)s + 3A}{s(s+3)}$
Step 2: Solve for A and B
Expand and group like terms: 1 = (A + B)s + 3A ⇒ A + B = 0 (coefficient of s), 3A = 1 (constant term). Solving for A and B: $A = \frac{1}{3}, B = -\frac{1}{3}$
Step 3. Write the Decomposed Form and Apply Inverse Laplace Transform
Using standard inverse Laplace Transforms: $\frac{1}{s(s+3)} = \frac{\frac{1}{3}}{s} + \frac{\frac{-1}{3}}{s+3} \leadsto_\mathcal{L}^{-1} \leadsto \frac{1}{3} -\frac{1}{3}e^{-3t}$ where we are using that $1 \leadsto \frac{1}{s}, e^{at} \leadsto \frac{1}{s-a}$ where s > a. The inverse Laplace Transform of $\frac{1}{s(s+3)}$ is: $\frac{1}{s(s+3)} \leadsto_\mathcal{L}^{-1} \frac{1}{3}(1 -e^{-3t}) $
Recall that $\mathcal{L}(e^{at}f(t)) = F(s-a), \mathcal{L}(t^{n}) = \frac{n!}{s^{n+1}}$. Our example is a translation with a = -1 of 1⁄s3 and n = 2.
$\mathcal{L}^{-1}(\frac{2}{(s+1)^3}) = 2·\mathcal{L}^{-1}(\frac{1}{(s+1)^3}) = 2·e^{-t}\frac{t^{2}}{2!} = e^{-t}t^2$
$\frac{s}{s^2-2s+5} = \frac{s}{(s-1)^2+2^2} = \frac{(s-1)+1}{(s-1)^2+2^2} = \frac{s-1}{(s-1)^2+2^2} + \frac{+1}{(s-1)^2+2^2}$
Recall $\mathcal{L}(sin(wt)) = \frac{w}{s^2+w^2}, \mathcal{L}(cos(wt)) = \frac{s}{s^2+w^2}, \mathcal{L}(e^{at}f(t)) = F(s-a)$
Applying the translation property again (with a = 1) and adjusting for the coefficient of the sine term: $\mathcal{L}^{-1}(\frac{s-1}{(s-1)^2+2^2} + \frac{+1}{(s-1)^2+2^2})= e^tcos(2t)+ \frac{1}{2}e^tsin(2t)$
This is a fundamental result in Laplace Transform theory and is widely used in solving differential equations and analyzing systems.
Let’s calculate the Laplace Transform of tn, where n is a non-negative integer. Recall that the Laplace Transform of a function f(t) is defined as:
$\mathcal{L}(f(t)) = F(s) = \int_{0}^{∞} f(t)e^{-st}dt$ where s is a complex number, typically with Re(s) > 0 to ensure convergence.
For f(t) = tn, the Laplace Transform becomes:
$\mathcal{L}(t^n) = \int_{0}^{∞} t^ne^{-st}dt$
To compute the integral, we will use the method of integration by parts, which is based on the formula: ∫udv =uv − ∫vdu.
A common strategy is to choose u as a function that becomes simpler when differentiated, and dv as a function that remains manageable when integrated, e.g., u = tn. We use the method of integration by parts repeatedly to reduce the power of t
u = tn ⇒ du = ntn-1dt, and dv = e-stdt, so $v = \frac{e^{-st}}{-s}$.
Using the integration by parts formula ∫udv =[Part A] uv − [Part B] ∫vdu, we get:
[Part A] $t^n\frac{e^{-st}}{-s}\bigg|_{0}^{∞} $
[Part B] $- \int_{0}^{∞} nt^{n-1}\frac{e^{-st}}{-s}dt = [1]$
[Part A] $\lim_{t \to ∞} t^n\frac{e^{-st}}{-s} = \frac{1}{-s}\lim_{t \to ∞} \frac{t^n}{e^{st}} = 0$ by n applications of L’Hospital’s rule (s > 0). As t → ∞, e-st decay exponentially (faster) while tn grows potentially! At t = 0, the term is also zero: $0^n·\frac{e^0}{-s} = 0$
[1] = $ 0 -0 [\text{ Part A }] + \frac{n}{s}\int_{0}^{∞} t^{n-1}e^{-st}dt = \frac{n}{s}\mathcal{L}(t^{n-1})$. Thus, we have a recursive relation.
We can apply the recursive formula repeatedly: $\mathcal{L}(t^n) = \frac{n}{s}\mathcal{L}(t^{n-1}) = \frac{n}{s}\frac{n-1}{s}\mathcal{L}(t^{n-2}) = ··· = \frac{n(n-1)···1}{s^n}\mathcal{L}(t^0) = \frac{n!}{s^n}\mathcal{L}(1) = \frac{n!}{s^n}\frac{1}{s} = \frac{n!}{s^{n+1}}$ for s > 0.
This result is fundamental and provides a direct way to compute the Laplace Transform of any non-negative integer power of t.
Recall that the Gamma function is defined as: $Γ(z) = \int_{0}^{∞} e^{-t}t^{z-1}dt$ for Re(z) > 0
$Γ(1) = \int_{0}^{∞} e^{-t}1^{z-1}dt = 1, Γ(n+1) = \int_{0}^{∞} e^{-t}t^{n}dt$
Integrating by parts. Let u = tn ⇒ du = ntn-1dt, dv = e-tdt, v = -e-t
$Γ(n+1) = \int_{0}^{∞} e^{-t}t^{n}dt = -e^{-t}t^n\bigg|_{0}^{∞}$
This first part ($-t^ne^{-t}\bigg|_{0}^{∞}$) is zero because the exponential decays exponentially, meaning faster than the polynomial grows.
$-\int_{0}^{∞} -e^{-t}·nt^{n-1}dt = n\int_{0}^{∞} e^{-t}·t^{n-1}dt = nΓ(n)$.
It can be recursively applied to get, Γ(n+1) = nΓ(n) = n(n-1)Γ(n-1) = ··· = n!
$\mathcal{L}(f(t)) = F(s) = \int_{0}^{∞} f(t)e^{-st}dt$ where s is a complex number, typically with Re(s) > 0 to ensure convergence.
By substituting st=u ⇒ sdt = du ⇒$dt = \frac{du}{s} $, we can write the integral as:
$\int_{0}^{∞} f(t)e^{-st}dt = \int_{0}^{∞} t^ne^{-st}dt = \int_{0}^{∞} e^{-u}\frac{u^n}{s^n}\frac{du}{s} = \frac{1}{s^{n+1}}\int_{0}^{∞} e^{-u}·u^ndu = \frac{1}{s^{n+1}}Γ(n+1) = \frac{n!}{s^{n+1}}$
Recall that the Laplace Transform of a function f(t) is given by: $\mathcal{L}(f(t)) = F(s) = \int_{0}^{∞} f(t)e^{-st}dt$
To ensure the Laplace Transform of a function f(t) exists (i.e., the integral converges to a finite value), we need to impose certain conditions on the behavior of f(t) as t grows. Specifically, the function should not grow too rapidly for large t, otherwise, the exponential decay of e-st may not be enough to ensure convergence, i.e., the integral involved in the Laplace Transform may not converge.
A function f(t) is said to be of exponential rate α if there exist positive constants M, α, and t0 such that |f(t)| ≤ Meαt, for all t ≥ t0. This condition means that f(t) does not grow faster than an exponential function.
For $\mathcal{L}(f(t))$ to exist:
Assuming f(t) is of exponential order α, we have: $|f(t)| ≤ Me^{αt}⇒ |f(t)e^{-st}| ≤ Me^{αt}e^{-st} = Me^{-(s-α)t}$ for t ≥ t0
$\int_{t_0}^{∞} |e^{-st}f(t)|dt ≤ \int_{t_0}^{∞} e^{-st}Me^{αt}dt = M\int_{t_0}^{∞} e^{ -(s-α)t}dt = M\frac{e^{-(s-α)t}}{-(s-α)}\bigg|_{t_0}^{∞} =[\text{s> α}] M(0-(\frac{e^{-(s-α)t_0}}{-(s-α)})) = M\frac{e^{-(s-α)t_0}}{(s-α)}$. This upper bound is finite when s > α, ensuring the integral converges on [t0,∞).
$|F(s)| = |\int_{0}^{∞} e^{-st}f(t)dt| ≤ |\int_{0}^{t_0} e^{-st}f(t)dt| + |\int_{t_0}^{∞} e^{-st}f(t)dt|$
Therefore, the Laplace Transform F(s) exists and is finite when s > α.
Observation: For any positive α, the exponential function eαt eventually outgrow any polynomial tn as t → ∞.
$\frac{t^n}{e^{αt}}≤ M$ for some M, and this is true because $\lim_{t \to ∞} \frac{t^n}{e^{αt}} = 0$ by n applications of L’Hospital’s rule (Each differentiation reduces the degree of the numerator, it becomes a constant n! and the denominator remains an exponential function multiplied by a polynomial term, which still grows exponentially) -since eαt grow faster than any polynomial tn!
This integral diverges because 1⁄t behaves too wildly near t = 0, so the Laplace Transform of 1⁄t does not exist. 1⁄t is not piecewise continuous on [0,∞) due to the infinite discontinuity at t = 0.
If f(t) grows faster than any exponential function (e.g., f(t)= $e^{t^2}$), the Laplace Transform may not exist.
$f(t)e^{-st} = e^{t^2-st} = e^{t(t-s)}$. As t → ∞, t(t-s) → ∞, so $f(t)e^{-st}$ grows with bond, hence the Laplace Transform does not exist.
In practice, the exponential growth condition ensures that the Laplace Transform can handle a wide variety of useful functions, including polynomials, exponentials, and trigonometric functions, all of which appear frequently in solving differential equations and modeling physical systems.