If you’re going through hell, keep on going, Winston Churchill.
Sometimes people don’t want to hear the truth because they don’t want their illusions destroyed, Friedrich Nietzsche.
Definition. A differential equation is an equation that involves one or more dependent variables, their derivatives with respect to one or more independent variables, and the independent variables themselves, e.g., $\frac{dy}{dx} = 3x +5y, y’ + y = 4xcos(2x), \frac{dy}{dx} = x^2y+y, etc.$
It involves (e.g., $\frac{dy}{dx} = 3x +5y$):
Definition. A first-order linear ordinary differential equation is an ordinary differential equation (ODE) involving an unknown function y(x), its first derivative y′, and functions of the independent variable x, which can be written in the general form:: a(x)y' + b(x)y = c(x) where:
These equations are termed “linear” because the unknown function y and its derivative y’ appear to the first power and are not multiplied together or composed in any nonlinear way.
If the function c(x)=0 for all x in the interval of interest, the equation simplifies to: a(x)y’ + b(x)y = 0. Such an equation is called a homogeneous linear differential equation.
The Existence and Uniqueness Theorem provides crucial insight into the behavior of solutions to first-order differential equations ODEs. It states that if:
Then, the differential equation y' = f(x, y) has a unique solution to the initial value problem through the point (x0, y0), meaning that it satisfies the initial condition y(x0) = y0.
This theorem ensures that under these conditions, the solution exists and is unique near x = x0.
In the study of differential equations and dynamical systems, non-linear autonomous systems are of great interest and play a crucial role due to their complex and rich behavior. One of the most fascinating phenomena exhibited by such systems is the occurrence of limit cycles.
A limit cycle is a closed, isolated trajectory in the phase plane that represents a periodic solution.
We consider a general two-dimensional non-linear autonomous system of the form:
$\begin{cases} x’ = f(x, y) \\ y’ = g(x, y) \end{cases}$ where:
By “autonomous,” we mean that these functions do not explicitly depend on time. The evolution of the system depends only on the current state (x, y), not on what time it is.
To gain a better understanding of the behavior of this system, we can represent the system as a velocity (or vector) field $\vec{F}$ in the plane. The velocity field is defined as: $\vec{F} = f(x, y)\hat{\mathbf{i}}+g(x, y)\hat{\mathbf{j}}$ where
This vector field describes how the values of x and y change over time at every point in the plane. Each point (x, y) has an associated vector $\vec{F}(x, y)$ indicating the instantaneous direction and speed of the system’s evolution starting from that point.
Thus, if we think of (x(t), y(t)) as the position of a “particle” moving in the plane, $\vec{F}(x, y)$ tells us the velocity of that particle at that instant.
Solutions to the system are pairs of functions x(t) and y(t), but geometrically, they are trajectories or paths traced out by the evolving system in the xy-plane (phase plane). These trajectories follow the direction of the vector field $\vec{F}$, meaning that at any point along the trajectory, the tangent to the path is given by $\vec{F}(x, y)$.
Refer to Figure i for a visual representation and aid in understanding it. Different initial conditions may lead to different trajectories, but these trajectories cannot cross each other. Non-crossing is a consequence of uniqueness of solutions: if two distinct solutions crossed at a point, that point would have two different future evolutions, which is impossible under standard conditions.
A critical point of the system occurs where the velocity field is zero, i.e., where the system's rate of change is zero. Mathematically, this happens when both $f(x_0, y_0) = 0, g(x_0, y_0) = 0$, meaning that the velocity at the point (x0, y0) is zero. At such points, the system is at equilibrium, meaning there is no motion, and the solution remains constant over time.
In terms of the field, these points are where: $\vec{F}(x_0, y_0) = f(x_0, y_0)\hat{\mathbf{i}}+g(x_0, y_0)\hat{\mathbf{j}} = \vec{0}$
Critical points are important because they often represent stable or unstable equilibrium states where the system tends to “settle” or from which it may “escape” in the long term, depending on the nature of the equilibrium.
The behavior near critical points can be analyzed using linearization and the eigenvalues of the Jacobian matrix:
J = $(\begin{matrix}\frac{∂f}{∂x} & \frac{∂f}{∂y}\\ \frac{∂g}{∂x} & \frac{∂g}{∂y}\end{matrix})\bigg|_{(x_0, y_0)}$
The eigenvalues of J determine the local behavior near the critical point:
A closed trajectory is a path in the xy-plane that loops back onto itself (to its starting point) and then repeats itself indefinitely. In other words, if a trajectory is closed, the system exhibits periodic behavior, that is, after a certain period T, the system returns to its initial state, and this cycle repeats over and over.
Geometrically, a closed trajectory represents a periodic solution (x(t), y(t)) such that: x(t + T) = x(t), y(t + T) = y(t) for all t.
Importantly, a closed trajectory does not cross itself —the system cannot have two different velocity directions at the same point due to the uniqueness of solutions in differential equations (Refer to Figure v for a visual representation and aid in understanding it). This property ensures that the system’s motion is uniquely determined by the initial conditions and evolves in a smooth, continuous manner.
The simple harmonic oscillator is a fundamental example in differential equations, classical mechanics, and physics, representing systems that exhibit purely periodic motion, such as springs and pendulums under ideal conditions.
Common real-world examples include a mass attached to a spring (obeying Hooke’s law) or a small-angle pendulum, each oscillating around an equilibrium position. The simple harmonic oscillator is linear, conservative (no energy loss), and its solutions are sinusoidal, indicating perfect periodic motion.
Consider the system of differential equations: $\begin{cases} x’ = y \\ y’ = -x \end{cases}$ where x = x(t) and y = y(t) are functions of time t (two variables that oscillate over time), and x’ and y’ denote derivatives of x and y, respectively with respect to time. This system describes how the variables x and y evolve over time, with each variable depending on the other.
Combining these, we can also derive a second-order differential equation for x alone: x’’ = y’ = -x, which is the classic form of a simple harmonic oscillator equation. In other words, this system describes a simple harmonic oscillator.
The matrix representation of the system is: $\vec{x’} = Ax$ where A = $(\begin{smallmatrix}0 & 1\\ -1 & 0\end{smallmatrix})$ is the coefficient matrix, and $\vec{x} = (\begin{smallmatrix}x\\ y\end{smallmatrix})$ is the state vector. This compact form allows us to use linear algebra techniques to solve the system.
To find the eigenvalues, we solve the characteristic equation: det(A-λI) = $det(\begin{smallmatrix}-λ & 1\\ -1 & -λ\end{smallmatrix}) = 0 ↭ (−λ)(−λ)−(1)(−1) = 0 ↭ λ^2 + 1 = 0 ↭ λ^2 = -1$. The eigenvalues are λ1 = i and λ2 = -i. The eigenvalues are purely imaginary. This indicates that the system exhibits rotational behavior (oscillatory) in the xy-plane (phase plane), trajectories in the (x, y)-plane will rotate around the origin, never spiraling in or out.
To find the eigenvectors, we substitute each eigenvalue back into $(A−λI)\vec{v} = \vec{0}$
For λ1 = i, $(\begin{smallmatrix}-i & 1\\ -1 & -i\end{smallmatrix})(\begin{smallmatrix}a_1\\ a_2\end{smallmatrix}) = (\begin{smallmatrix}0\\ 0\end{smallmatrix})$
From the first equation: -ia1 +a2 = 0 ⇒ a2 = ia1. From the second row: -a1 -ia2 = 0 ⇒[Substitute a2 = ia1] -a1 -i(ia1) = -a1 + a1 = 0. We can choose a1 = 1 (since eigenvectors are determined up to a scalar multiple). Therefore, the eigenvector is: $\vec{v_1}=(\begin{smallmatrix}1\\ i\end{smallmatrix})$
For λ2 = -i, $(\begin{smallmatrix}i & 1\\ -1 & i\end{smallmatrix})(\begin{smallmatrix}a_1\\ a_2\end{smallmatrix}) = (\begin{smallmatrix}0\\ 0\end{smallmatrix})$
From the first equation: ia1 +a2 = 0 ⇒ a2 = -ia1. Choosing a1 = 1, we have: $\vec{v_2}=(\begin{smallmatrix}1\\ -i\end{smallmatrix})$
The general complex solution to the system in complex form is a linear combination of the eigenvectors multiplied by the exponential of their eigenvalues: $\vec{x}(t) = c_1e^{it}\vec{v_1} + c_2e^{-it}\vec{v_2}$ where c1 and c2 are complex constants determined by initial conditions.
Substituting the eigenvectors: $\vec{x}(t) = c_1e^{it}(\begin{smallmatrix}1\\ i\end{smallmatrix})+c_2e^{-it}(\begin{smallmatrix}1\\ -i\end{smallmatrix})$
To find real-valued solutions, we express the complex exponentials using Euler’s formula: $e^{it} = cos(t) + isin(t), e^{-it} = cos(t) - isin(t)$
Substitute back into the general solution: $\vec{x}(t) = c_1(cos(t)+isin(t))(\begin{matrix}1\\ i\end{matrix})+c_2(cos(t)-isin(t))(\begin{matrix}1\\ -i\end{matrix}) = (\begin{matrix}c_1(cos(t)+isin(t))+c_2(cos(t)-isin(t))\\ c_1(icos(t)-sin(t))+c_2(-icos(t)+sin(t))\end{matrix})$
Let’s use the real and imaginary parts of the complex solutions to construct real solutions.
First Real Solution. Take the real part of $e^{it}\vec{v_1}$: $\mathbb{R}[e^{it}\vec{v_1}] = (\begin{smallmatrix}cos(t)\\ -sin(t)\end{smallmatrix})$
Second Real Solution. Take the imaginary part of $e^{it}\vec{v_1}$: $\mathbb{ℑ}[e^{it}\vec{v_1}] = (\begin{smallmatrix}sin(t)\\ cos(t)\end{smallmatrix})$
Therefore, the general real solution is: $c_1(\begin{smallmatrix}cos(t)\\ -sin(t)\end{smallmatrix})+c_2(\begin{smallmatrix}sin(t)\\ cos(t)\end{smallmatrix})$ where c1 and c2 are real constants determined by initial conditions.
The solutions x(t) and y(t) represent sinusoidal functions with the same frequency but possibly different amplitudes and phases. The trajectories in the phase plane are closed curves, specifically circles or ellipses, depending on the constants c1 and c2.
For the simple harmonic oscillator, this is a family of concentric circles centered at the origin, representing periodic motion [1]. Each trajectory is a closed curve, and the motion goes around clockwise indefinitely, which is typical of simple harmonic oscillators. (Refer to Figure ii for a visual representation and aid in understanding it).
In linear systems like the simple harmonic oscillator, all trajectories are closed curves (circles) but are not isolated —there is a family of closed trajectories filling the phase plane.
Linear systems do not have limit cycles in the strict sense because limit cycles are a feature of non-linear systems where closed trajectories are isolated.
For the simple harmonic oscillator, the trajectories are circles centered at the origin [1]. To see this, consider the expressions x(t) = c1cos(t) + c2sin(t), y(t) = -c1sin(t) + c2cos(t).
$x^2(t)+y^2(t) =[\text{Expanding both terms}] c_1^2·cos^2(t) + 2c_1c_2sin(t)cos(t) + c_2^2·sin^2(t) + c_1^2·sin^2(t) -2c_1c_2sin(t)cos(t) +c_2^2cos^2(t) =[\text{Simplify}] c_1^2(cos^2(t)+sin^2(t)) + c_2^2(sin^2(t) + cos^2(t)) + (2c_1c_2sin(t)cos(t)-2c_1c_2sin(t)cos(t)) = (c_1^2+c_2^2)(cos^2(t)+sin^2(t)) = c_1^2+c_2^2 ↭ x^2(t)+y^2(t) = c_1^2+c_2^2 = R^2$ where R = $\sqrt{c_1^2+c_2^2}$ is the radius of the circle. Therefore, the trajectories of the system are circles of radius R centered at the origin.
A limit cycle is a special type of closed trajectory in the phase plane of a dynamical system. Consider a system described by two variables, x and y, whose values change over time according to a set of differential equations. The phase plane is a two-dimensional plane where the horizontal axis represents the variable x and the vertical axis represents the variable y. Each point in the phase plane corresponds to a particular state of the system (a particular combination of x and y).
A trajectory in the phase plane is the path traced out by the system’s state as it evolves over time from a given initial condition (x0, y0). A closed trajectory is one where the system eventually returns to the exact same state it started from, causing the path to form a closed loop.
A limit cycle is a closed trajectory in the phase plane that is isolated, meaning that nearby trajectories are not closed and either spiral towards or away from the limit cycle.
Limit cycles are significant because they represent sustained, ongoing oscillations in the system, which can be:
Limit cycles do not occur in linear systems; they are unique to non-linear systems due to their complex interactions. In linear systems, any closed trajectories (such as circles or ellipses generated by a center equilibrium) are not isolated —they form a continuum of closed orbits filling a region in the phase plane, and thus, they do not satisfy the definition of a limit cycle.
One real-world example of a limit cycle is the natural process of breathing. Breathing is a periodic motion that can be modeled as a limit cycle. If the system (your breathing) is disturbed, say, by a temporary obstruction, physical exercise, or a moment of stress, anxiety or panic, it will gradually return to its original, stable pattern of breathing. This resilience to disturbances and return to the original periodic motion is a hallmark, a key characteristic of a stable limit cycle.
Understanding and determining whether a given system has a limit cycle is a crucial challenge in the study of non-linear dynamical systems. Unfortunately, there is no universal formula or method to directly predict or determine the existence of limit cycles for every non-linear system.
There are various approaches used by mathematicians and researchers to predict and identify limit cycles:
While finding limit cycles can be difficult, in some cases, it is possible to rule out their existence by applying specific criteria.
Bendixson’s Criterion is a method for excluding the existence of closed trajectories (and hence, limit cycles) within a region of the plane.
Bendixson’s criterion. Let D be a simply connected region of the xy-plane. Consider a continuously differentiable vector field: $\vec{F} = f(x, y)\hat{\mathbf{i}} + g(x, y)\hat{\mathbf{j}}$ governing the system:
$\begin{cases} x’ = f(x, y) \\ y’ = g(x, y) \end{cases}$
The divergence of the vector field is given by: $div \vec{F} = f_x + g_y = \frac{∂f}{∂x} + \frac{∂g}{∂y}$, where f(x, y) and g(x, y) are the components of the vector field governing the time evolution of x and y, respectively. If the divergence $div(\vec{F})$ is continuous throughout the region D and does not change sign (meaning it is always positive or always negative) and is not identically zero, then there are no closed trajectories (and therefore no limit cycles) lying entirely within D.
If the divergence of the vector field is always positive or always negative in the region D, it implies that the flow is either consistently diverging (spreading out, pushing trajectories outward behaving like a source) or converging (coming together, pulling trajectories inward behaving like a sink) throughout the region. This consistent behavior prevents the trajectories from closing onto themselves (loop around and close around) to form limit cycles within D.
$\begin{cases} x’ = x^3 + y^3 \\ y’ = 3x + y^3 + 2y \end{cases}$
The vector field for this system is $\vec{F} = (x^3 + y^3)\hat{\mathbf{i}} + (3x + y^3 + 2y)\hat{\mathbf{j}}$
Let’s compute the divergence of the vector field: $div \vec{F} = f_x + g_y = 3x^2 + 3y^2 +2$. Notice that $div \vec{F} > 0$ in ℝ2 (it is always positive since x2≥0, y2≥0 ∀x, y and there is an additional positive term 2)⇒[By Bendixson’s criterion] Since the divergence is always positive and constant throughout the plane, there can be no closed trajectories in the xy-plane ⇒There are no limit cycles anywhere in the system.
Important Caveat of Bendixson’s Criterion.
It’s important to note that Bendixson’s Criterion can only be used to exclude the possibility of limit cycles within a region. If the divergence changes sign or is zero somewhere in D, the criterion does not provide any information about the existence of limit cycles; other methods must be used.
Proof (indirect proof)
Assume, for the sake of contradiction, that there exists a closed trajectory C within the region D. Let R be the region enclosed by the curve C (Refer to Figure iv for a visual representation and aid in understanding it).
Consider the vector field $\vec{F} = f(x, y)\hat{\mathbf{i}} + g(x, y)\hat{\mathbf{j}}$ governing the system:
$\begin{cases} x’ = f(x, y) \\ y’ = g(x, y) \end{cases}$
Since C is a trajectory of the system, the vector field (velocity field) $\vec{F}$ is always tangent to the curve (the curve is a trajectory, it is supposed to be going in the direction given by the vector field) at every point. Therefore, the normal vector and the vector field are perpendicular, i.e., their dot product is zero: $\vec{F}·\hat{\mathbf{n}} = 0$.
The flux integral of the vector field $\vec{F}$ across C is given by:
$\oint_{C} \vec{F}·\hat{\mathbf{n}}ds$ where:
As we have previously stated, since $\vec{F}$ is tangent to C, $\vec{F}·\hat{\mathbf{n}} = 0$. Therefore, the flux across C is zero: $\oint_{C} \vec{F}·\hat{\mathbf{n}}ds = 0$
By Green’s Theorem, the flux integral over a closed curve C can be converted to a double integral over the region R enclosed by C: $\oint_{C} \vec{F}·\hat{\mathbf{n}}dS = \int\int_{R} div(\vec{F})dA$, where:
Since the flux across C is zero, we have: $\int\int_{R} div(\vec{F})dA = 0$
However, we have already assumed that:
Under these conditions, the divergence is either $div(\vec{F}) > 0$ or $div(\vec{F}) < 0$ for all points in R. Since R has a positive area, and $div(\vec{F}) $ is non-zero of a constant sign the integral of the divergence over the region R $\int\int_{R} div(\vec{F})dA$ must be either strictly positive ($div(\vec{F}) > 0$) or negative ($div(\vec{F}) < 0$) ⊥ Therefore, the assumption that a closed trajectory C exists is false. Hence, under the given conditions, there are no closed trajectories (limit cycles) within the region D.
Critical point criterion (Poincaré-Bendixson) is closely related to the Poincaré-Bendixson theorem. If a closed trajectory C exists within a region D in the xy-plane, then there must be at least one critical point (also known as an equilibrium point) inside the region enclosed by that closed trajectory C.
A critical point is a point (x0, y0) where the system’s dynamic “pause”; in other words, the velocity vector is zero at that point. Formally, for a system:
$\begin{cases} x’ = f(x, y) \\ y’ = g(x, y) \end{cases}$
a critical point is a solution (x0, y0) satisfying f(x0, y0) = 0 and g(x0, y0) = 0.
Contrapositive Logic. The contrapositive of a statement “If A, then B” (A⇒B) is the logically equivalent statement “If not B, then not A” (¬B⇒¬A). Applying this to the critical point criterion:
This means that if you can identify a region D in the plane that contains no critical points, then you can conclude that no closed trajectories (limit cycles) exist within D.
Consider the following non-linear autonomous system:
$\begin{cases} x’ = x^2 + y^2 + 1 \\ y’ = x^2 -y^2 \end{cases}$
To investigate whether limit cycles exist, we can first apply Bendixson’s Criterion. It states that that if the divergence of the vector field is continuous and does not change sign (i.e., it is either strictly positive or strictly negative) in a simply connected region D, then there are no closed trajectories (and hence no limit cycles) lying entirely within D.
Given the vector field $\vec{F} = f(x, y)\hat{\mathbf{i}}+g(x, y)\hat{\mathbf{j}}$ where $f(x, y) = x^2 + y^2 + 1, g(x, y) = x^2 -y^2$. The divergence of the vector field $\vec{F}$ is given by: $div(\vec{F}) = \frac{∂f}{∂x} + \frac{∂g}{∂y} = 2x-2y$.
Analyzing the Divergence. Set the divergence equal to zero: 2x -2y = 0 ⇒ x -y = 0 ⇒ x = y. This tells us that along the line y = x, the divergence is zero.
Signs of the Divergence
Applying Bendixson’s Criterion
In regions where the divergence is strictly positive or strictly negative and continuous, Bendixson’s Criterion tells us that no closed trajectories can exist entirely within those regions.
Next, we use the critical point criterion to check whether the system has any critical points. The Critical Point Criterion states:
Critical points occur where both derivatives x′ and y′are zero simultaneously.
However, this is impossible because: $x’ = x^2+y^2+1 > 0$ (there are not real solutions to x2 + y2 = -1) ⇒ There are no critical points in the real plane system. ⇒Since there are no critical points in the system, by the contrapositive of the critical point criterion, we can conclude that the system does not have any limit cycles.
Since $x’ > 0$ for all $(x, y)$, this implies all trajectories will move rightward indefinitely as time progresses, so they cannot look back on themselves to form a closed trajectory. This alone is sufficient to rule out limit cycles.
To determine whether limit cycles can exist in the given spring-mass-damper system with non-linear damping, we will apply Bendixson’s Criterion. This criterion helps us identify whether closed trajectories, and hence limit cycles, are possible in a particular region of the phase plane by examining the divergence of the vector field.
The governing equation for this system is: $x’’ + c(x)x’ + x = 0.$
To analyze this system in the phase plane, we convert this into a first-order system by introduction a new variable y’ = x. Then, we have:
$\begin{cases} x’ = y \\ y’ = -x -c(x)y \end{cases}$
This gives us the vector field $\vec{F} = f(x, y)\hat{\mathbf{i}}+g(x, y)\hat{\mathbf{j}}$ where where f(x, y) = y, g(x, y) = -x -c(x)y.
To investigate whether limit cycles exist, we can apply Bendixson’s Criterion. It states that if the divergence of the vector field $\vec{F}$ is continuous and does not change sign (i.e., it is either strictly positive or strictly negative) in a simply connected region D, then there are no closed trajectories (and thus no limit cycles) can exist entirely within D.
The divergence of the vector field $\vec{F}$ is given by: $div(\vec{F}) = \frac{∂f}{∂x} + \frac{∂g}{∂y} = 0 -c(x)$
Applying Bendixson’s Criterion:
Since c(x) > 0 by definition, we have: $div(\vec{F}) = -c(x) < 0$ ∀x, y.
The divergence is strictly negative for all x and y (assuming c(x) is continuous). Thus: