Algorithmic Patterns
Classic Two Pointers Pattern
Two Pointers Opposite
Use Case
The list input is sorted, and you are looking for a pair (or pairs) that meet a specific condition.
Usage
def two_pointers_opposite(array):
left = 0
right = len(array) - 1
result = 0
while left < right:
# Some logic involving `array[left]` and/or `array[right]`
if <condition>:
left += 1
else:
right -= 1
return result
Two Pointers Same Speed
Use Case
The two list inputs are sorted, and you want to compare elements between the two.
Usage
def two_pointers_same_speed(array1, array2):
i = 0
j = 0
result = 0
while i < len(array1) and j < len(array2):
# Some logic involving `array1[i]` and `array2[j]`
if <condition>:
i += 1
else:
j += 1
while i < len(array1):
# Some logic involving `array1[i]`
i += 1
while j < len(array2):
# Some logic involving `array2[j]`
j += 1
return result
Sliding Window Pattern
Fixed Sliding Window
Use Case
You are looking for a subarray or substring of some length k
that satisfies a certain constraint.
Usage
def fixed_sliding_window(array, k):
current = 0
result = 0
for i in range(k):
# Some logic to build first window involving `current` and/or other variables
for right in range(k, len(array)):
# Add `array[i]` to window
# Remove `arr[i - k]` from window
# Update `result`
return result
Variable Sliding Window
Use Case
You are looking for a subarray or substring (usually the longest) that satisfies a certain constraint.
Usage
def variable_sliding_window(array):
left = 0
current = 0
result = 0
for right in range(len(array)):
# Some logic to add `array[right]` to `current`
while <broken window condition>:
# Remove `array[left]` from `current`
left += 1
# Update `result`, where current window length
# at any time is `right - left + 1`
return result
Note (When this Technique Fails)
The constraint must be preserved as the sliding window shrinks. If shrinking the window can break the constraint, consider using a prefix sum + hash map technique instead.
Note (Length of a Window)
The formula for the length of a window isright - left + 1
.
Prefix Sum Pattern
Use Case
You need a subroutine which involves finding the sum of any subarray in \(O(1)\).
Usage
def build_prefix_sum(nums):
prefix_sum = [0]
for num in nums:
prefix_sum.append(prefix_sum[-1] + num)
return prefix_sum
# Usage:
# To get the sum from [i, j), perform `prefix[j] - prefix[i]`
HashMap and HashSet Pattern
HashMap
Use Case
- Track elements seen so far for uniqueness (with any extra info stored as the value)
- Frequency counting
- Basic mapping
- Memoization table
- Count number of subarrays with a constraint that doesn't necessarily hold as you shrink the window
def count_num_subarrays_with_exact_constraint(array, k):
freq = {0 : 1} # prefix sum frequency map
prefix_sum = 0
result = 0
for num in array:
# Some logic to change `prefix_sum` as necessary (e.g. prefix_sum += num)
result += freq.get(prefix_sum - k, 0)
freq[prefix_sum] += freq.get(prefix_sum, 0) + 1
return result
Usage
# Create an empty map
my_map = dict()
# Create a map with initial values
my_map = {
<key 1>: <value 1>,
<key 2>: <value 2>
}
# Add new entry or update current entry
my_map[<immutable key>] = <value>
# Remove an entry
del my_map[<key>]
# Remove all entries
my_map.clear()
# Get number of entries
len(my_map)
# Check if my_map is empty
not my_map
# Get value
my_map[<key>]
# Get the value with a default value if key isn't found
# Note: I like thise over `defaultdict(<default value type>)` for counting since it can avoid accidentally creating phantom keys
my_map.get(<key>, <default value>)
# Note: pretty much a must for adjacency list creation
from collections import defaultdict
my_map = defaultdict(<default value's type>)
# Check if key exists
<key> in my_map
# Get all entries
my_map.items()
# Get all keys
my_map.keys()
# Get all values
my_map.values()
HashSet
Use Case
- Track elements seen so far for uniqueness
- Store a chunk (or all) of the input for fast lookups
#### Usage
# Create an empty set
my_set = set()
# Add an element
my_set.add(<element>)
# Check if a set contains an element
<element> in my_set
# Remove an element
my_set.remove(<element>)
# Get the set difference
my_set.difference(other_set)
# Get the set intersection
my_set.intersection(other_set)
# Get the set union
my_set.union(other_set)
# Remove all elements
my_set.clear()
# Get the number of elements
len(my_set)
# Check if the set is empty
not my_set
Fast and Slow Pointers/Floyd's Cycle Detection Pattern
Use Case
- Detect cycles in linked list
- Find middle of a linked list
Usage
def fast_and_slow_pointers(head):
fast = head
slow = head
result = <initial value>
while fast and fast.next:
# Some logic
fast = fast.next.next
slow = slow.next
Reversing a Linked List Pattern
Use Case
- The problem largely involves reversing pointers in a linked list
- You need a subroutine which involves classically reversing pointers in a linked list
Usage
def reverse_linked_list(head):
prev_node = None
curr_node = head
while curr_node:
next_node = curr_node.next
curr_node.next = prev_node
prev_node = curr_node
curr_node = next_node
**Note (Dummy Head)
Create a dummy head nodedummy = listnode(0, head)
to reduce edge cases.
Stack and Queue Pattern
Stack
Use Case
Elements in the input interacting with each other, with a LIFO order.
Usage
# Create an empty stack
stack = list()
# Push an element onto the top
stack.append(<element>)
# Pop the element at the top
stack.pop()
# Get the element at the top
stack[-1]
# Get the number of elements in the stack
len(stack)
# Check if the stack is empty
not stack
Note (\(O(n)\) String Building)
We often use the stack to store the result and convert it to a string using the \(O(n)\) string builder Technique.
def build_string(string):
array = []
for char in string:
array.append(char)
return "".join(array)
Queue
Use Case
Processing elements in a FIFO order.
Usage
from collections import deque
# Create a queue from an initial list
queue = deque(<initial list>)
# Enqueue an element at the back
queue.append(<element>)
# Dequeue the element at the front
queue.popleft()
# Get the element at the front
queue[0]
# Get the number of elements
len(queue)
# Check if queue is empty
not queue
Monotonic Stack and Monotonic Deque Pattern
Monotonic Stack
Use Case
- Looking for the "next" or "previous" "greater" or "smaller" element
- "Span until" i.e. counting a range
Usage
def monotonic_non_decreasing_stack(array):
stack = []
result = <initial value>
for i in range(len(array)):
while stack and array[stack[-1]] > array[i]:
stack.pop()
# Utilize stack.pop() in result
# e.g. result[stack.pop()] = <something involving i>
# e.g. result += stack.pop()
stack.append(i)
return result
Monotonic Deque
Use Case
Maximum or minimum values in sliding window or ranges.
Usage
from collections import deque
def monotonic_non_increasing_deque(array, k):
result = []
dq = deque()
for i in range(len(array)):
while dq and array[dq[-1]] < array[i]:
dq.pop()
dq.append(i)
if dq[0] <= i - k:
dq.popleft()
if i >= k - 1:
result.append(array[dq[0]])
return result
Note (Monotonicity)
A monotonic increasing/decreasing stack or queue implies that the elements are always increasing/decreasing, while a monotonic non-decreasing/non-increasing one may include repeated elements.
Note (Indices Tweak)
Store indices when you want to calculate distances or want to mutate the result list later.
Binary Tree Traversal Patterns
Binary Tree Depth-First Search
Use Case
Most binary tree problems that don't involve processing nodes by their levels.
Usage
def recursive_preorder_dfs(root):
if not root:
return <base case result>
# Additional base cases
# Some logic involving the current node and the current result
recursive_preorder_dfs(root.left)
recursive_preorder_dfs(root.right)
return <current result and the two recursive calls above>
def iterative_preorder_dfs(root):
stack = [root]
result = <initial value>
while stack:
node = stack.pop()
# Additional base cases
# Some logic involving the popped node and the result
if node.right:
stack.append(node.right)
if node.left:
stack.append(node.left)
return result
Note (Edge Cases)
- Empty tree (i.e.
None
root)- Single node tree
- Skewed tree (i.e. unbalanced trees where all nodes are on one side)
- Duplicate values in a binary search tree
Note (Common Depth-First Search Visit Order)
In the iterative depth-first search, the flow is usually pre-orderpop node → process node → push right → push left
, while in the recursive depth-first search, pre-orderprocess node → recurse left → recurse right
is the most common, followed by post-orderrecurse left → recurse right → process node
, then in-orderrecurse left → process node → recurse right
.
Note (Additional Context)
In a recursive depth-first search, when you need to track additional context or values across recursive calls—such as parent nodes, path lengths, or accumulated data—you include that information as an additional parameter. In an iterative depth-first search, you would store them as part of a tuple(node, <value 1>, <value 2>, <…>, <value N>)
that'll be pushed and popped from the explicit stack you create outside the while loop.
Note (Keeping Track of the Final Result)
In a recursive depth-first search,result
is typically implicit since it's usually sufficient to implicitly be returned, but an explicitresult
is sometimes a good choice, where you create it within the scope of the provided function, then create and call an inner depth-first search function to do the actual work. In an iterative depth-first search, you typically create an explicitresult
variable outside the while loop.
Note (BST Techniques)
BST problems typically use DFS traversal. Common Techniques include:
- Checking if the current node's value is within bounds (e.g.,
low <= node.val <= high
)- Leveraging the BST property to prune subtrees — if
node.val < low
, skip the left subtree; ifnode.val > high
, skip the right subtree (wherelow
orhigh
can also just be a target value)- Using inorder traversal to collect values in sorted order for problems requiring sorted data without explicit sorting.
Binary Tree Breadth-First Search
Use Case
Binary tree problems that involve processing nodes by their levels.
Usage
from collections import deque
def bfs(root):
if not root:
return
queue = deque([root])
result = 0
while queue:
level_width = len(queue)
# Some logic involving the current level
for _ in range(level_width):
node = queue.popleft()
# Some logic involving the current node
if node.left:
queue.append(node.left)
if node.right:
queue.append(node.right)
return result
Graph Traversal Patterns
Adjacency List Graph Depth-First Search
Use Case
Most graph problems.
Usage
def adjacency_list_recursive_dfs(graph):
def dfs(vertex):
visited.add(vertex)
result = <initial value>
for neighbour in graph[vertex]:
if neighbour not in visited:
result += dfs(neighbour)
return result
result = <initial value>
visited = set()
for vertex in graph:
if vertex not in visited:
dfs(vertex)
# Some logic involving the result per connected component
def adjacency_list_iterative_dfs(graph):
def dfs(vertex):
result = <initial value>
stack = [vertex]
while stack:
vertex = stack.pop()
visited.add(vertex)
for neighbour in graph[vertex]:
if neighbour not in visited:
result += <calculation>
stack.append(neighbour)
return result
result = <initial value>
visited = set()
for vertex in graph.keys():
if vertex not in visited:
dfs(vertex)
# Some logic involving the result per connected component
Matrix Graph Depth-First Search (Flood Fill)
Use Case
Most graph problems where the input is a matrix.
Usage
def matrix_recursive_dfs(matrix):
ROWS = len(matrix)
COLUMNS = len(matrix[0])
# NOTE: each element is of the form (change in row, change in col)
DIRECTIONS = [(1, 0), (-1, 0), (0, -1), (0, 1)]
def valid_cell(row, col):
return 0 <= row < ROWS and 0 <= col < COLUMNS and <another condition for a cell to be valid>
def dfs(row, col):
visited.add((row, col))
result = <initial value>
for dr, dc in DIRECTIONS:
neighbour_row = row + dr
neighbour_col = col + dc
if valid_cell(neighbour_row, neighbour_col) and (neighbour_row, neighbour_col) not in visited:
result += dfs(neighbour_row, neighbour_col)
return result
visited = set()
result = <initial value>
for row in range(ROWS):
for col in range(COLUMNS):
if (row, col) not in visited:
dfs(row, col)
# Some logic involving the result per connected component
return result
def matrix_iterative_dfs(matrix):
ROWS = len(matrix)
COLUMNS = len(matrix[0])
# NOTE: each element is of the form (change in row, change in col)
DIRECTIONS = [(1, 0), (-1, 0), (0, -1), (0, 1)]
def valid_cell(row, col):
return 0 <= row < ROWS and 0 <= col < COLUMNS and <another condition for a cell to be valid>
def dfs(row, col):
stack = [(row, col)]
result = <initial value>
while stack:
row, col = stack.pop()
visited.add((row, col))
for dr, dc in DIRECTIONS:
neighbour_row = row + dr
neighbour_col = col + dc
if valid_cell(neighbour_row, neighbour_col) and (neighbour_row, neighbour_col) not in visited:
result += <some calculation>
stack.append((neighbour_row, neighbour_col))
return result
visited = set()
result = <initial value>
for row in range(ROWS):
for col in range(COLUMNS):
if (row, col) not in visited:
dfs(row, col)
# Some logic involving the result per connected component
return result
Adjacency List Graph Breadth-First Search
Use Case
Distance in a graph.
Usage
from collections import deque
def adjacency_list_bfs(graph):
queue = deque([(<source vertex>,<additional state>, <initial distance>)])
visited = set([<source vertex>])
while queue:
vertex, <additional state>, dist = queue.popleft()
if vertex == <destination vertex>:
return dist
for neighbour in graph[vertex]:
if neighbour not in visited:
visited.add(neighbour)
queue.append((neighbour, <additional state>, dist + 1))
# Some logic involving the neighbour
Matrix Graph Breadth-First Search
Use Case
Distance in a graph given as a matrix.
Usage
def matrix_iterative_bfs(matrix):
ROWS = len(matrix)
COLUMNS = len(matrix[0])
# NOTE: each element is of the form (change in row, change in col)
DIRECTIONS = [(0, 1), (1, 0), (1, 1), (-1, -1), (-1, 1), (1, -1), (-1, 0), (0, -1)]
def valid_cell(row, col):
return 0 <= row < ROWS and 0 <= col < COLUMNS and <another condition for a cell to be valid>
queue = deque([(<source vertex>,<additional state>, <initial distance>)])
visited = set([(<source vertex>, <initial distance>)])
while queue:
row, col, dist = queue.popleft()
if (row, col) == (<destination row>, <destination col>):
return dist
for dr, dc in DIRECTIONS:
neighbour_row = row + dr
neighbour_col = col + dc
neighbour_dist = dist + 1
if (neighbour_row, neighbour_col) not in visited and valid_cell(neighbour_row, neighbour_col):
visited.add((neighbour_row, neighbour_col))
queue.append((neighbour_row, neighbour_col, <additional state>, neighbour_dist))
# Some logic involving the neighbour's row and col
Note (Various Types of Graph Inputs)
Unlike linked lists and binary trees, which we are givenhead
orroot
respectively, there are various graph inputs:
- Matrix: A 2D list, where each element will represent a vertex, but are not numbered
0
ton
, its neighbours are the adjacent squares, and the edges are determined by the problem description.- Edge list: A list of edges
edges
. It's useful to turn it into an adjacency list.from collections import defaultdict def build_adjacency_list_graph(edges): graph = defaultdict(list) for u, v in edges: graph[x].append(y) graph[y].append(x) # comment out this line if the input is a directed graph return graph
- Integer Adjacency List: A 2D list of integers
graph
, wheren
nodes are numbered from0
ton - 1
, andgraph[i]
represents the neighbours of nodei
.- Integer Adjacency Matrix: A 2D list of integers, where
n
nodes are numbered from0
ton - 1
, thereby forming ann x n
square matrix, and where whengraph[i][j] == 1
, there exist an edge between nodei
and nodej
, and whengraph[i][j] == 0
, there is no edge between nodei
and nodej
. It's also useful to pre-process it into an adjacency list.from collections import defaultdict def build_adjacency_list_graph(adjacency_matrix): graph = defaultdict(list) n = len(adjacency_matrix) for i in range(n): for j in range(i + 1, n): if adjacency_matrix[i][j]: graph[i].append(j) graph[j].append(i) # comment out this line if the input is a directed graph return graph
Although, even if the input is none of the above, it may still be an implicit graph problem, often where vertices aren't explicitly given, but can be generated on the fly through valid transitions or transformations. These problems typically involve:
- A starting state and a goal/end state
- A defined set of valid transitions or mutations
- Optional constraints like invalid/intermediate states
Note (
visited
Container)
visited
is typically a HashSet, but you might achieve better runtime performance by using a boolean array when the node range is predetermined (which is typical since graph problems usually number nodes from0
ton - 1
)
Note (Prohibited Vertices)
Whenever the problem mentions prohibited vertices, then that's an indicator to add them straight away to thevisited
container.
Note (Distance vs Path Length for BFS)
When using BFS to find shortest paths:
- If the problem asks for distance (number of moves/steps), initialize source vertices with
distance = 0
- If the problem asks for path length (number of cells in the path), initialize source vertices with
path_length = 1
Note (Multi-source BFS)
For a multi-source BFS, create a for loop that visits all source nodes and appends them to the queue for the BFS.
Note (Reframing the Problem)
For graph problems, it's useful to rephrase the problem in terms of its inverse. For instance, take LeetCode #1557. The original problem description asks us to find the smallest set of vertices from which all nodes in the graph are reachable. Instead, we can rephrase the problem description in terms of its inverse — find the smallest set of nodes that cannot be reached from other nodes, since if a node can be reached from another node, then we would rather just include the pointer rather than the pointee in our set. Another example is LeetCode #542. The brute force solution would be to perform BFS for each cell with a 1, but instead, we can perform a multi-source BFS by performing starting from all cells with a 0 (if we have a cellx
with value 1 and its nearest cell y has value 0, then it doesn't make a difference if we traverse fromx -> y
ory -> x
— both give the same distance).
Priority Queue Pattern
Use Case
- Repeatedly find the maximum or minimum element
- Get the "top" \(k\) elements (create an empty priority queue that prioritizes the elements you want to discard — use a min heap to keep the largest
k
elements, or a max heap to keep the smallestk
; insert elements from the input list, and whenever the queue exceeds sizek
, pop the root to maintain only the topk
you care about)
import heapq
def top_k(array, k):
pq = []
for num in array:
# Some logic to push add an element according to problem's criteria
heapq.heappush(pq, (<criteria as key>, num))
if len(pq) > k:
heapq.heappop(pq)
return [num for _, num in pq]
- Finding a median (involves one max heap priority queue for the lower half of the list, and one min heap priority queue for the upper half of the list)
Usage
import heapq
# Create an empty priority queue
priority_queue = []
heapq.heapify(priority_queue)
# Add an element
heapq.heappush(priority_queue, <element>)
# Remove the top element
heapq.heappop(priority_queue)
# Peek at the top element
priority_queue[0]
# Get the number of elements
len(priority_queue)
# Check if the priority queue is empty
not priority_queue
Note (Heaps in Python's Standard Library)
Python'sheapq
module only implements min‐heaps. To simulate a max heap, first build a new listpq
from the elements of the input but negated using-
, callheapq.heapify(pq)
, and then negate each popped value to get back the original.
Note (Using a Key for Priority)
To assign priority based on a specific key, wrap each item in your list as a tuple:(key, element)
. For max heaps, you must negate the key by-
, and if the question involves tie-breakers, negate the element by-
.
Greedy Algorithm Pattern
Use Case
Typically finding the minimum or the maximum of a property of the input array.
Usage
- Determine if you should greedily pick the minimum or the maximum at each step.
- Sort the input array (often you may need to sort based on the frequency of each element using
Counter(<list>)
). - Iterate over the sorted array and increment the result, making use of a heap as needed.
Binary Search Pattern
On an Array
Use Case
For some input array, array
, and a desired element target
, array
must be sorted, and you want to:
- Find the index of
target
if it is inarray
. - Find the lower bound (first index) or upper bound (last index) at
target
can be inserted to maintain the sorted order ofarray
.
Usage
def binary_search(array, target):
left = 0
right = len(array) - 1
while left <= right:
mid = (left + right) // 2
if array[mid] == target:
# Some logic
return
if array[mid] < target:
left = mid - 1
else:
left = mid + 1
return left # if `target` is not in `array`, `left` is at the insertion point
def lower_bound(array, target):
"""
Finds the first index at which `target` can be inserted in `array`
to maintain sorted order (i.e., the lower bound).
If `target` exists in `array`, returns the index of its first occurrence.
If `target` does not exist, returns the index where it can be inserted.
Equivalent to bisect.bisect_left in the Python standard library.
Parameters:
array (List[int]): A sorted list of integers.
target (int): The value to search for.
Returns:
int: The index of the lower bound for `target`.
"""
left = 0
right = len(array)
while left < right:
mid = (left + right) // 2
if arr[mid] < target:
left = mid + 1
else:
right = mid
return left
def upper_bound(array, target):
"""
Finds the first index at which a value greater than `target`
can be inserted in `array` to maintain sorted order (i.e., the upper bound).
Returns the index of the first element greater than `target`.
If all elements are less than or equal to `target`, returns `len(array)`.
Equivalent to bisect.bisect_right in the Python standard library.
Parameters:
array (List[int]): A sorted list of integers.
target (int): The value to search for.
Returns:
int: The index of the upper bound for `target`.
"""
left = 0
right = len(array)
while left < right:
mid = (left + right) // 2
if arr[mid] <= target:
left = mid + 1
else:
right = mid
return left
Note (Duplicate Elements)
binary_seach()
doesn't work ifarray
contains duplicates, butlower_bound()
andupper_bound()
does allow duplicates inarray
.
Note (Descending Elements)
If the input array is sorted in descending order, simply invert the inequality in the if condition.
On a Solution Space
Use Case
You're trying to find a maximum or minimum value, and:
- You can verify (usually with a greedy algorithm) in \(O(n)\) time (or faster) whether a given candidate
x
is a valid solution. - If
x
is a valid solution:- For a maximum, \(\text{all values} \le x\) are also valid.
- For a minimum, \(\text{all values} \ge x\) are also valid.
- If
x
is not a valid solution:- For a maximum, \(\text{all values} \gt x\) are also invalid.
- For a minimum, \(\text{all values} \lt x\) are also invalid.
Usage
def binary_search_minimum(array):
def is_valid(x):
# Some O(n) algorithm (usually also a greedy algorithm)
return <boolean>
left = <min possible answer>
right = <max possible answer>
while left <= right:
mid = (left + right) // 2
if is_valid(mid):
right = mid - 1
else:
left = mid + 1
return left
def binary_search_maximum(array):
def is_valid(x):
# Some O(n) algorithm (usually also a greedy algorithm)
return <boolean>
left = <min possible answer>
right = <max possible answer>
while left <= right:
mid = (left + right) // 2
if is_valid(mid):
left = mid + 1
else:
right = mid - 1
return right
Note (Safely Calculating
mid
)
For most languages, to avoid integer overflow, calculatemid
using this formula insteadleft + (right - left) / 2
.
Backtracking (Complete Search)
Unconstrained Backtracking
Use Case
Generating permutations, subsets, or combinations
Template
class Solution:
def permute(self, nums: List[int]) -> List[List[int]]:
result = []
def backtrack(path):
if len(path) == len(nums):
result.append(path.copy())
return
for num in nums:
if num not in path:
path.append(num)
backtrack(path)
path.pop()
backtrack([])
return result
class Solution:
def subsets(self, nums: List[int]) -> List[List[int]]:
result = []
def backtrack(path, start):
if start > len(nums):
return
result.append(path.copy())
for i in range(start, len(nums)):
curr.append(nums[i])
backtrack(path, i + 1)
path.pop()
backtrack([], 0)
return result
class Solution:
def combine(self, n: int, k: int) -> List[List[int]]:
result = []
def backtrack(path, start):
if len(path) == k:
result.append(path.copy())
return
for num in range(start, n + 1):
path.append(num)
backtrack(path, num + 1)
path.pop()
backtrack([], 1)
return result
Backtracking with pruning
Use Case
Constraints
Usage
TO DO
Note (Backtracking as a Decision Tree)
A backtracking solution can be visualized as a tree, where each node represents the current state of the path during a recursive function call. Thebacktrack()
calls explore different branches of this tree, building potential solutions along the way. The leaves of the tree correspond to base cases—often representing complete solutions, though not necessarily in every problem.