uGitMe

uGitMe

The Push: July 17th, 2026

Schemas, agent guardrails, and tiny local models powering faster APIs, safer workflows, and private assistants

Anshul Desai's avatar
Anshul Desai
Jul 17, 2026
∙ Paid

Protocol Buffers: APIs Should Speak Compactly

github.com/protocolbuffers/protobuf | License: Other

Every popular app hides the same boring problem: data has to move constantly, between phones and servers, between microservices, between teams writing in different languages. JSON made that flow readable, but readability gets expensive fast when payloads get huge, schemas drift, and latency starts stacking up across every request. Protocol Buffers became the fix because they treat data exchange like infrastructure, not documentation. Honestly, that framing matters more than the file format itself. This repo is less about serialization trivia, more about making software systems agree on reality cheaply and reliably.

The Drop: When Simple Payloads Stop Being Simple

Slack messages, ride updates, payment events, recommendation feeds, fraud checks, every modern product is really a chain of services passing structured facts around. That sounds manageable until one backend is in Java, another is in Go, mobile clients are on Swift and Kotlin, and each team tweaks fields on its own schedule. Suddenly the easy choice, usually JSON, starts charging hidden rent in larger payloads, slower parsing, and awkward backward compatibility.

Protobuf showed up to solve exactly that coordination mess. Not by making data prettier, but by making structure explicit and machine-first. A shared schema defines what a message means, then every language gets generated types that encode and decode the same contract. That removes a ton of ambient ambiguity.

Google’s original pain is still everyone else’s pain: systems scale faster than communication habits do. The frustration is not just bandwidth, though that matters. The bigger problem is trust. Can one service add a field without breaking another? Can mobile apps lag behind server changes without exploding? Can data stay compact and evolvable? That tension is why this repo never stopped mattering.

The Stack: A Compiler Hiding in Plain Sight

Underneath, Protocol Buffers is a C++ core repo centered on the protoc compiler and language runtimes for ecosystems like Java, Python, C#, Ruby, PHP, and Objective-C. Build support runs through Bazel and CMake, with adjacent language-specific repos, e.g. Go and JavaScript, extending the same schema contract across stacks.

The Sauce: Schemas as the Product Surface

What makes Protocol Buffers interesting is the split between .proto schemas, code generation, and a compact wire format that preserves meaning across languages without requiring each service to negotiate behavior at runtime. That three-part architecture is the whole bet.

Schemas are the source of truth. Developers describe messages once, including field numbers, names, and types. The compiler then generates native classes for each target language, which means application code deals with typed objects instead of generic blobs. Underneath those objects, the binary encoding stays small and fast because messages are serialized by field tags rather than verbose keys. That is why protobuf keeps showing up in latency-sensitive systems, e.g. RPC layers, streaming pipelines, and mobile backends.

The deeper design choice is field numbering. Every field gets a stable numeric identity, and those numbers are what travel on the wire. Names can help humans, but numbers preserve compatibility. Add a new optional field, older clients ignore what they do not understand. Remove a field carelessly, and you risk semantic drift. Reserve field numbers properly, and the contract survives years of product churn. That is the clever bit.

This turns the schema into an organizational API, not just a technical one. Teams can evolve independently because compatibility rules are encoded into the format itself. Plenty of tools serialize data. Protocol Buffers makes long-lived distributed systems less fragile, which is a much bigger job.

The Move: Turn Contracts Into Operating Discipline

Founders and product teams usually notice Protocol Buffers after scale pain appears, but the smarter move is earlier adoption anywhere multiple services or clients need to stay aligned over time. A startup building a realtime product, e.g. logistics, multiplayer, fintech, health data, can use Protocol Buffers to lock down message contracts before integration debt becomes cultural debt.

One practical use case is internal platform standardization. Define shared event and API schemas once, then generate language-specific models for every team. That cuts hand-written integration logic, reduces serialization bugs, and makes migrations less political because compatibility rules are already baked in. Another strong move is mobile efficiency. Smaller payloads and faster parsing directly affect responsiveness when every network round trip counts.

Strategically, Protocol Buffers gives a company a cleaner path to service decomposition. Systems can split into specialized components without every boundary becoming a custom translation project. That lowers coordination cost as headcount grows. The upside is not just engineering elegance. Faster partner integrations, safer product iteration, and lower infra overhead all feed margin. Boring, yes. Also exactly the kind of boring that compounds.

The Aura: Software Starts Making Fewer Assumptions

Product teams quietly change behavior when data contracts become explicit. Fewer meetings are needed to confirm what an event means, fewer defensive checks get scattered across apps, and fewer launch delays come from one client being out of sync with another. That changes expectations inside a company.

Protocol Buffers pushes software toward a world where structure is negotiated upfront, then trusted for a long time. Humans stop babysitting glue code and start treating interfaces as durable assets. Reliability becomes something designed into communication itself, not patched on after bugs show up.

The Play: The Invisible Toll Road

From a VC lens, Protocol Buffers is not a fresh 0-to-1 category today. It is the canonical infrastructure layer in a massive existing TAM: API infrastructure, event streaming, service communication, mobile backends, and data platforms. The repo signals extreme PMF through sheer longevity and adoption depth, with 71,521 stars, broad language support, and durable community maintenance. The moat is not network effects in the social sense, it is workflow entrenchment, schema switching costs, and ecosystem gravity around generated code, RPC tooling, and internal standards.

Winners:

  • Buf: Distribution shifts toward schema management, linting, and breaking-change governance, which compounds because protobuf-heavy teams eventually need policy, registries, and collaboration layers.

  • Confluent: Event-driven architectures get easier to standardize with strongly typed contracts, lifting LTV as more enterprises treat streaming and schemas as one operating system.

  • Cloudflare: Edge services benefit from compact cross-service payloads, improving performance economics in ways that strengthen an already massive network business.

Losers:

  • Postman: Manual API exploration matters less when orgs standardize around generated contracts and machine-readable schemas, which makes adaptation hard for a workflow built around human-inspected payloads.

  • RapidAPI: Aggregation gets thinner when serious platform teams prefer governed internal contracts over loosely standardized payload marketplaces.

  • Twilio: Verbose legacy integration patterns look more expensive as customers expect lower-latency, strongly typed communication across distributed systems.

tl;dr

Protocol Buffers turns data contracts into compiled infrastructure, with schemas, generated types, and a binary wire format that keep systems fast and compatible as they grow. The clever part is stable field numbering, which lets software evolve without constant coordination drama. Worth a look for anyone building APIs, event systems, or mobile-heavy products.

Stars: 71,521 | Language: C++

User's avatar

Continue reading this post for free, courtesy of Anshul Desai.

Or purchase a paid subscription.
© 2026 Anshul Desai · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture