All You Need Is Schema: A Cross-Language, Cross-Team Approach to Data Contracts
Brandon Brown, SecurityScorecard
Wed, Nov 4, 3:15–4:00 PMRoom 2008
As engineering organizations scale, so does the cost of data inconsistency. Teams multiply, languages diverge, and the subtle misunderstandings between producers and consumers accumulate until something breaks in production. At SecurityScorecard, we confronted this head-on by adopting a schema-first engineering culture — and building the open source tooling to make it stick.
This talk is a practitioner's guide to building a centralized schema codebase that works across multiple programming languages and database technologies. We'll cover how we use buf cli and bash scripting to generate cross-language client libraries from a single source of truth, what schema compatibility checks actually look like in a CI/CD pipeline, and how we integrated with DataHub to give both frontend and backend teams a shared view of the contract landscape — so frontend engineers can build against generated types the day a proto lands, without waiting on backend.
We'll dig into the real decisions: how to structure a schema monorepo, how to enforce compatibility without slowing teams down, and how ownership lines get drawn when a schema change touches five services. We'll also cover what this looks like with and without Kafka in the picture — and what to do when a schema registry isn't available.
By the end of this session, you'll leave with:
- A concrete pattern for centralized, multi-language schema management
- Practical guidance on integrating buf cli into your existing CI workflows
- A clear mental model for schema ownership and backward/forward compatibility
- A proven approach to unblocking parallel FE/BE development through contract-first design
- Lessons learned from rolling this out across engineering teams at SecurityScorecard
Speaker
-
Brandon Brown
Senior Engineering Manager, SecurityScorecard
Brandon Brown is a Senior Engineering Manager at SecurityScorecard where he leads the team who provide the scores at the core of our ratings platform. These scores guide cybersecurity leaders worldwide in reducing their risk and addressing risk in their vendors. His team also drives secure data sharing and advances company-wide adoption of streaming technologies.
With 10+ years of experience in software development, Brandon has experience across the full SDLC specializing in Data Pipelines over the last 8+ years. His language of choice is Scala but he has a soft spot for SQL. He’s contributed to top open source projects such as Hardwood, Debezium and was an early contributor to the ZIO ecosystem. He’s passionate about Kafka and Hybrid Data Pipeline strategies. Outside of work he’s helping raise his young son and catching live music or talking about movies.