An Introduction To Stochastic Calculus

October 30, 2012

When performing integration, differentiation, evaluating sums and products; our evaluations use numbers (usually real, sometimes complex). They define the “answer” we get; a physical interpretation into understanding what we have done.

Suppose instead of numbers, we use variables. Specifically, we use random variables. Then we are using a new calculus; appropriately named stochastic calculus, stochastic meaning random.

This post is not going into probability theory nor will it define what a random variable is, specifically we introduce stochastic calculus without any extreme formality.

Suppose you want to look at the stock market, or anything that enough humans touch in response of being able to gain something in return, say an environment. Say we define X(t) to be the price of asset X at time t, then consider some time period t + dt, we ask several questions:

How small does dt need to be?
What happens when it’s infinitesimal?

Does it relate to some specific probability distribution?
Can we make a formula for X without involving any explicit, complicated functions?

First we continue with our asset, given a change in time, we have a change in price dX(t).

Suppose the asset’s environment is responsive to change and there are many users like us, the controller of the asset; all looking after their asset. Is the change in the asset price simply just how the market fluctuates at the given time, multiplied by some constant for normalisation?

Suppose this is true and thus we have the differential equation dX(t)=\sigma* dW(t).

(where dX(t) is the change in price of the asset at time t, \sigma is a constant and dW(t) is some bizarre function that can understand and display the change in market fluctuations and how the market, and generally environment, responds to our asset.

Integrating and using some initial condition (X(0)=\alpha), we have a seemingly nice and a intuitive solution.

We have X(t) = \alpha + \sigma \int dW(t)

For short time periods (specifically, for really short) it works fine. But it’s hugely problematic.

As time increases, the probability of the asset having a negative price is bigger than zero, ie non zero, therefore it can happen on some day, or specifically some time period. Formally we have the statement “P(X(T)<;0) to be strictly bigger than zero" to be true.

Initially we think it’s not too probable but just that it exists gives us problems. Who’s going to trust or use some differential equation that says the probability of the asset having a negative price at some future time using that differential equation is non zero?

So we go back to our differential equation. Do we start over again? Not really, we just think sensibly. Suppose I have some hot tea that I want to drink it when it is just right. So I let it “play” in the environment and then make a judgement on whether I should drink it or not.

Relating to our problem, an investor or user of an asset will look at the potentials gain or loss (change) dX(t) as opposed to the initial asset price, this shows that we think about not only the price, but how the price changes in the future, despite trying to answer the future.

So we have the relative price change to be the proportional to market fluctuations, we have \frac{dX(t)}{X(t)}=\sigma * dW(t)

Now by integrating from the initial price to the variable t, this gives us X(t)=\alpha + \sigma * \int X(t) dW(t) .

Surely we can solve this, right? Trying our usual elementary methods makes no sense since our W(t) function is the function that looks at market fluctuations – in mathematical terms; nowhere differentiable and non continuous, so we arre stuck.

Unless we define a new integral equation and a new kind of calculus; the counterpart to real numbers, one for random variables. We have stochastic calculus.

Questions:

What happens when the time increments approach zero? (Brownian Motion)

With limiting zero time increments do we have a differentiable market fluctuation function? What probability distributions do we use to understand how this process works? (Poisson process)

What new type of integral do we define to solve the weird integral we have on the right hand side? (Ito integral)

This new integral must apply to some kind of calculus given that we will be differentiating it at some point and other proper tires, specifically what is this calculus and what special defining properties does it have? (Stochastic calculus)

Here we stop given that the questions asked cover enough of the motivation to study stochastic calculus, however for further enthusiasts we ask more questions and give some new ideas.

Given a discrete random variable mapped by some specific distribution, in between time intervals we can actually use a continuous random variable to “travel” through the time increments. The related distributions are the Poisson and Exponential (and discrete analogy Geometric). How can we use these distributions to understand what is happening in our asset price change, or in our differential equation?

This W(t) function, supposedly non differentiable everywhere, having a limiting time increment to zero may change how it behaves. It may even make solving the DE easier, but there are problems with it. What are these problems? Why do we care for small time increments?

Stochastic Calculus requires good knowledge of probability theory, real analysis, linear algebra and a few other bachelor level modules (complex analysis, differential equations, Hilbert spaces) to fully let it sink in.


Lecture 1: Sets, Real Numbers, Fields, Ordered Fields

October 30, 2012

The real number system is a set \{a,b,c, ...\} on which the operations of addition and multiplication are defined so that every pair of real numbers (say a and b) has a unique sum and product, both real numbers, with the following properties:

Given any (and all) a,b,c \in \mathbb{R}, we have

(A) a+b=b+a and a*b=b*a (Commutative laws)

(B) (a+b)+c=a+(b+c) and (a*b)*c=a*(b*c) (Associative laws)

(C) a*(b+c)=a*b+a*c (Distribute law)

(D) There exist distinct real numbers 0 and 1 such that a+0=a and a*1=a, for all a.

(E) For each a there is a real number -a such that a+(-a)=0 and if a \neq 0, there is a real number \frac{1}{a} such that a*\frac{1}{a}=1

A set on which two operations are defined so as to have properties (A) – (E) is a field.

Motivation: Think about these properties for a second before moving on. (A) establishes what the operations do, (B) then asks what happens when we include more elements, a “double operation” if you like. (C) then mixes the two operands into one. (D) and (E) are closely related. Suppose we want to add an element to our given real number that… gives us our real number? So we are adding nothing, or 0. Suppose we have the same idea for our other operand, multiplication, we have the real number 1 to do this for us.

Then we ask, can we find real numbers that give us what we just discovered, namely 0 and 1 from addition and multiplication? For that we have -a and \frac{1}{a} with a \neq 0 for the second condition.

Exercise: Can you think of another example of a field?
Exercise: Do the set of integers \mathbb{Z} form a field? Verify through (A) – (E).

The real number system is ordered by the relation <;, which has the following properties:

(F) For each pair of real numbers a and b, exactly one of the following is true: a <; b, a=b, b<;a.

(G) If a<;b and b<;c then a<;c. (Transitive)

(H) If a<;b, then a+c<;b+c for any c and if b<;c then a*c<;b*c.

A field with an order relation satisfying (F) – (H) is an ordered field. The real numbers (and rationals) form an ordered field.

Suppose we get bored of the real numbers and define a new field satisfying everything \mathbb{R} does but is defined as such. For any a,b \in \mathbb{R} we define a new number z as z = a+b*\imath, where \imath^2 = -1. We call this set \mathbb{C}, the set of complex numbers.

Exercise: Verify that \mathbb{C} is a field.
Exercise: Is \mathbb{C} an ordered field? (Use (F) – (H) to prove order or give a counterexample)
(Hard) Exercise: Why have we defined \imath^2 = -1 and not \imath=\sqrt{-1}?

Questions to think about:

Are all fields ordered fields?
Are finite fields ordered?
What do these two above questions (if and when answered) say about ordered fields? (Hint: Infinite number of…)


The Motivation Behind Real Analyis

October 21, 2012

When I ask anyone who is not a mathematician (and even some who are) what a “number” is, they never define what a “number” is, but say something along the lines of “well a thing you add to get another thing, like 2+2=4”. But here we had defined “+”, which I do not know of, have not defined and do not have much care for; I asked a different question. We see numbers as “left and right” on some big “interval”, this is also wrong. We will see this by the end of the first lecture.

The motivation behind this course is to build some proper rigour into understanding what, how and why analysis is/operates/works.

(When probability is taught wrong, it leads to bad knowledge of quantum physics, statistics(bizarrely), stochastic models, differential equations. Anything with randomness.)

When real analysis is taught wrong, it leads to bad knowledge of everything taught later on in maths: probability, calculus (vector calculus too), geometry, complex analysis, Fourier analysis, group theory, just a few to name, really cannot be taught without some specific and excellent knowledge of real analysis.

It makes sense (which through out this blog I will be saying… a lot) to begin with my notes for the course “An Introduction To Real Analysis”.

But… What if you have no mathematical knowledge? No worries. The prerequisites are nothing. Especially not calculus (integration or differentiation). But you should have some mathematical ability, what do we assume? That you know that a “real number” is. That is all. You do not even need to know what addition or multiplication are. To be honest; I hope you do not.

If you do have some mathematical knowledge, the notes will not be so interesting but the excercises should keep (some are very difficult, some very easy) you awake. And if you have a lot of mathematical knowledge, you may wish to simply download these notes for your own need; to teach others as a lecturer, as a prerequisite to your course, or just to have some real analysis notes, which is always handy.