How Mobility Helps AI Understand Places and City Rhythms

Peter Bubenik ยท Google Research blog ยท ยท Source
Image for How mobility gives language models a deeper understanding of place

After studying this material, you should be able to:

  1. Explain why static metadata alone is insufficient for AI models to understand real-world places
  2. Describe how mobility data enriches place representations in language models
  3. Understand the three-step ME-POIs pipeline and what problem each step solves
  4. Interpret the significance of experimental results and what they reveal about urban dynamics
  5. Distinguish between individual-level and aggregate-level mobility understanding

Step-by-Step Teaching

Step 1: The Core Problem โ€” Two Signatures of Every Place

Think about a coffee shop. It has:

Signature TypeWhat It ContainsExample
Identity (Static)Name, category, address, description"Cafรฉ, downtown, serves coffee"
Function (Dynamic)When people actually visit, how long they stayBusy 7โ€“9am, quiet afternoons

Traditional AI models only see the first signature.

๐Ÿ”‘ Key Insight: A text description cannot tell you whether a restaurant is a lunch spot or a late-night diner. But real-world visit patterns can.


Step 2: What Are Embeddings and Why Do They Matter?

Before going further, you need to understand one technical concept:

An embedding is a numerical vector โ€” essentially a list of numbers โ€” that represents something (a word, sentence, or place) in a way a computer can mathematically process.

"Italian Restaurant" โ†’ [0.82, 0.14, 0.67, 0.33, ...]

Think of it like a fingerprint โ€” a compact mathematical signature that captures meaning.

๐Ÿ”‘ Key Insight: ME-POIs creates embeddings that encode both identity AND function of a place, rather than identity alone.


Step 3: Introducing ME-POIs โ€” The Solution Framework

ME-POIs (Mobility-Embedded Points of Interest) is a framework that:

  • Takes standard text-based place representations from language models (like Gemini)
  • Blends them with aggregated, anonymized mobility patterns
  • Produces a richer, more accurate numerical signature of each place
Text Embedding + Mobility Patterns = ME-POI Embedding
(Who you are)    (How you behave)    (Complete picture)

โš ๏ธ Important Clarification: This uses aggregate, anonymized data โ€” it cannot identify or track individual users.


Step 4: The Three-Step Pipeline

๐Ÿ”ง Step 4A โ€” Visit Alignment (Temporal Encoding)

Problem: How do you convert raw visit timestamps into something mathematically useful?

Solution: A temporal encoder analyzes:

  • Arrival time windows
  • Departure trends
  • Typical stay durations

It then maps these patterns into a "functional centroid" โ€” a multidimensional signature representing how a place is visited across:

  • Different times of day
  • Different days of the week
  • An entire year cycle

Analogy: Imagine plotting every visit to a gym on a calendar. The resulting pattern (heavy Monday mornings, quiet Wednesday afternoons) becomes the gym's functional fingerprint.


๐Ÿ”ง Step 4B โ€” Spatial Multiscale Visit Propagation

Problem: The "Long Tail" Problem

Most places don't generate much data:

Famous Mall โ†’ Thousands of visits โ†’ Rich data โœ…
Small boutique โ†’ Few visits โ†’ Sparse data โŒ

When data is sparse, models incorrectly assume zero activity, breaking predictions.

Solution: Borrow patterns from neighbors across multiple spatial scales:

Street Level โ†’ Block Level โ†’ Neighborhood Level
     โ†“               โ†“               โ†“
  Immediate      Slightly         Broader
  neighbors      wider area       context

Logic: A small boutique on a high-end shopping street shares behavioral rhythms with its busy neighbors. The framework statistically transfers those patterns to data-sparse places.

Analogy: If you don't know a new restaurant's hours, you can reasonably infer them from similar restaurants on the same block.


๐Ÿ”ง Step 4C โ€” Text-Mobility Synergy

Problem: How do you combine two very different types of information (text and mobility) without losing either?

Solution: Align both representations by maximizing cosine similarity โ€” a mathematical measure of how closely two vectors point in the same direction.

Text Embedding:     [captures WHAT a place is]
Mobility Embedding: [captures HOW a place functions]
         โ†“
    Combined ME-POI: [captures BOTH]

Result:

  • Preserves structural semantics โ†’ "This place sells food"
  • Adds operational context โ†’ "This place functions as a lunch spot"

Step 5: Experimental Validation โ€” Does It Actually Work?

Testing Setup

FactorDetail
Cities testedLos Angeles and Houston (culturally distinct)
Key test conditionTrained on known places, tested on entirely unseen places
Compared againstText-only models, trajectory-based models, hybrid variations

Testing on unseen places is critical โ€” it proves the model learned general understanding, not just memorization.

Five Prediction Tasks Evaluated

  1. Visit Intent โ€” Why is someone visiting this place?
  2. Price Level Classification โ€” Is this budget, mid-range, or expensive?
  3. Busyness Estimation โ€” How crowded is it?
  4. Opening Hours Prediction โ€” When is it open?
  5. Business Status โ€” Is it currently active?

Results

TaskImprovement
Visit Intent+81.9% relative gain
Price Level Classification+75.1% improvement
Busyness Estimation+24.7% increase

Step 6: The Most Surprising Finding

"Mobility-only models outperformed text-only models in price-level classification."

What this means:

Where people go and how long they stay reveals more about a place's price level than its written description does.

Why this makes intuitive sense:

  • A luxury restaurant's description might use vague language
  • But its visit patterns (long dinners, weekend evenings, extended stays) clearly signal high-end pricing

๐Ÿ”‘ Deeper Insight: Our collective behavior at places is often more descriptive than the formal labels we assign to them.


Step 7: What ME-POIs Cannot Do โ€” Important Boundaries

Understanding limitations is as important as understanding capabilities:

ME-POIs CANME-POIs CANNOT
Represent aggregate place behaviorTrack individual users
Predict attributes of unseen placesPersonalize recommendations
Capture temporal rhythms of citiesDraw conclusions about specific people
Reduce computational burden on downstream AIReplace individual-level data analysis

Summary โ€” The Complete Picture

BEFORE ME-POIs:
Place = Static text label
โ†’ Limited, frozen representation

AFTER ME-POIs:
Place = Text identity + Mobility function
โ†’ Dynamic, temporally-aware representation
โ†’ Better predictions across multiple tasks
โ†’ Works even for data-sparse places
โ†’ Generalizes to unseen locations

The fundamental shift ME-POIs introduces:

Mobility data moves from being an output to predict โ†’ to being an input that defines the place itself


Quick Self-Check Questions

  1. Why is static metadata alone insufficient for understanding places?
  2. What is an embedding, and what makes ME-POI embeddings different?
  3. How does spatial multiscale propagation solve the long-tail problem?
  4. Why is testing on unseen places more meaningful than testing on known places?
  5. What does it mean that mobility-only models beat text-only models at price prediction?

More to study