PGD01C01
Module 1 · Set Theory, Relations and Combinatorics

Mathematical Induction

Core Titles
Key headlines and terms for quick recall
  • Principle of Mathematical Induction
  • Base case P(1)P(1)
  • Inductive hypothesis assume P(k)P(k)
  • Inductive step prove P(k+1)P(k+1)
  • Strong (complete) induction
  • Common applications: sums, divisibility, inequalities, recursion
Basic Idea
What it is, why it matters, how it works

The idea

To prove a statement P(n)P(n) for every natural number nn, induction lets us replace infinitely many proofs with two steps:

  1. Base case — show P(1)P(1) (or whichever smallest nn).
  2. Inductive step — assume P(k)P(k) (induction hypothesis) and prove P(k+1)P(k+1).

If both succeed, P(n)P(n) holds for all n1n \ge 1 — like dominoes falling.

Strong induction

Sometimes proving P(k+1)P(k+1) needs all of P(1),,P(k)P(1), \dots, P(k), not just P(k)P(k). Strong induction assumes all previous cases hold. It is equivalent in power to ordinary induction.

Standard worked examples

Sum of first nn naturals. Claim: 1+2++n=n(n+1)21 + 2 + \cdots + n = \dfrac{n(n+1)}{2}.

  • Base n=1n=1: LHS = 1, RHS = 122=1\tfrac{1 \cdot 2}{2} = 1. ✓
  • Step: assume i=1ki=k(k+1)2\sum_{i=1}^k i = \tfrac{k(k+1)}{2}. Then i=1k+1i=k(k+1)2+(k+1)=(k+1)(k+2)2\sum_{i=1}^{k+1} i = \tfrac{k(k+1)}{2} + (k+1) = \tfrac{(k+1)(k+2)}{2} — exactly P(k+1)P(k+1). ✓

Divisibility. 3(n3n)3 \mid (n^3 - n) for all n1n \ge 1.

  • Base: n=1n=1, 11=01 - 1 = 0 — divisible. ✓
  • Step: assume 3(k3k)3 \mid (k^3 - k). Then (k+1)3(k+1)=k3+3k2+3k+1k1=(k3k)+3(k2+k)(k+1)^3 - (k+1) = k^3 + 3k^2 + 3k + 1 - k - 1 = (k^3 - k) + 3(k^2 + k). Both terms divisible by 3. ✓

Why this matters in Data Science

Induction is the standard tool for proving correctness of recursive algorithms (merge sort, divide-and-conquer) and for bounding their complexity.

Mind Map
Visual structure of the concept
MATHEMATICAL INDUCTION
├── Goal: prove P(n) ∀ n ≥ n₀
├── Two-step recipe
│   ├── BASE: P(n₀) holds
│   └── STEP: P(k) ⇒ P(k+1)
├── Strong induction
│   └── Assume P(n₀)…P(k) to prove P(k+1)
└── Applications
    ├── Sum formulas
    ├── Divisibility
    ├── Inequalities (e.g. 2ⁿ > n)
    ├── Recursive definitions
    └── Algorithm correctness
Exam Q&A
Part A (2 marks) and Part B (20 marks) style questions

Part A (2 marks each)

Q1. State the principle of mathematical induction. If P(1)P(1) is true and P(k)P(k+1)P(k) \Rightarrow P(k+1) for all kk, then P(n)P(n) is true for all n1n \ge 1.

Q2. What is the difference between weak and strong induction? Weak induction assumes only P(k)P(k) to prove P(k+1)P(k+1); strong induction assumes P(1),,P(k)P(1), \dots, P(k).

Q3. By induction, what is 1+2++n1 + 2 + \cdots + n? n(n+1)2\dfrac{n(n+1)}{2}.


Part B (20 marks)

Q. Prove by induction that 12+22++n2=n(n+1)(2n+1)61^2 + 2^2 + \cdots + n^2 = \dfrac{n(n+1)(2n+1)}{6} for all n1n \ge 1. Also prove 2n>n2^n > n for all n1n \ge 1.

Part 1. Let P(n):  12+22++n2=n(n+1)(2n+1)6P(n): \; 1^2 + 2^2 + \cdots + n^2 = \dfrac{n(n+1)(2n+1)}{6}.

Base n=1n=1: LHS = 1, RHS = 1236=1\dfrac{1\cdot 2\cdot 3}{6} = 1. ✓

Step. Assume P(k)P(k) holds. Then i=1k+1i2=k(k+1)(2k+1)6+(k+1)2.\sum_{i=1}^{k+1} i^2 = \dfrac{k(k+1)(2k+1)}{6} + (k+1)^2. Factor (k+1)(k+1): =(k+1)[k(2k+1)+6(k+1)]6=(k+1)(2k2+7k+6)6=(k+1)(k+2)(2k+3)6.= \dfrac{(k+1)\big[k(2k+1) + 6(k+1)\big]}{6} = \dfrac{(k+1)(2k^2 + 7k + 6)}{6} = \dfrac{(k+1)(k+2)(2k+3)}{6}. This matches P(k+1)P(k+1). ∎

Part 2. Let Q(n):  2n>nQ(n): \; 2^n > n.

Base n=1n=1: 2>12 > 1. ✓

Step. Assume 2k>k2^k > k. Then 2k+1=22k>2k=k+kk+12^{k+1} = 2 \cdot 2^k > 2k = k + k \ge k + 1 (since k1k \ge 1). So 2k+1>k+12^{k+1} > k+1. ∎