Building an Architecture to Predict Customer Behavior in a Revenue-Critical System

At Neon digital bank in Brazil, we strive to make revenue-impacting predictions based on customer behavior. Building a low latency and high availability distributed system that meets this requirement becomes especially challenging.

In this talk, I will present how Neon improved the reliability, transparency and quality of its credit decisions by taking advantage of machine-learning models running on Tensorflow Serving and how we integrated the process with a credit approval backend on Go. I'll cover:

  • How to carefully roll out a new credit modeling system using dark launches and observability tools.
  • How Tensorflow Serving simplifies the serving path for machine-learning models, despite a few quirks and limitations.
  • How to meet latency and reliability requirements through network proximity while complying with regulatory constraints.

Speaker

Yves Junqueira

Distinguished Software Engineer @Neon

Yves is a Distinguished Software Engineer at Neon, a leading Brazilian digital bank. He spearheads key engineering challenges related to customer acquisition and credit, utilizing distributed systems, data engineering, data science, and machine learning to create financial products for working Brazilians. Prior to joining Neon, Yves served as the CEO of YourBase, a software testing accelerator for large codebases. Under his leadership, YourBase raised $5 million and was acquired by FalconX, where he worked as the Engineering Leader, responsible for high-performance trading systems and the development of new products.

With a background spanning Brazil, Switzerland, the USA, and Portugal, Yves brings a unique perspective to his work in the tech industry. Before his experience in startups, Yves spent over 9 years at Google, where he was a Senior Reliability Engineer, specializing in large scale distributed storage systems such as Bigtable, Colossus, and Spanner. He also created and led the development of a popular internal Go microservices framework and worked on the design, implementation, and deployment of large scale automation and orchestration systems.

Read more

Date

Wednesday Jun 14 / 01:40PM EDT ( 50 minutes )

Location

Salon A-C

Topics

Architecture Reliability AI/ML Fintech

Video

Video is not available

Share

From the same track

Session Architecture

Reliable Architectures Through Observability

Wednesday Jun 14 / 02:55PM EDT

We want our systems to be reliable, but testing alone isn't enough. In a complex, multi-service system, it's impossible to test your way to correctness. That's why we need observability. Observability is the ability to see what our code is doing, in production and in development.

Speaker image - Kent Quirk

Kent Quirk

Staff Engineer @Honeycomb.io

Session Kafka

How to Build a Reliable Kafka Data Processing Pipeline, Focusing on Contention, Uptime and Latency

Wednesday Jun 14 / 10:35AM EDT

Shifting workloads from synchronous to asynchronous can simplify the operational cost of high-throughput HTTP services. But understanding the evolution of performance metrics in the world of complex, high-concurrency, asynchronous distributed systems can be quite challenging.

Speaker image - Lily Mara

Lily Mara

Engineering Manager @OneSignal

Session Developer Environment

Architecting a Production Development Environment for Reliability

Wednesday Jun 14 / 04:10PM EDT

At Meta, developers use a combination of development servers, including virtual machines and physical hosts, as well as on-demand containers to perform their daily software engineering work.

Speaker image - Henrique Andrade

Henrique Andrade

Production Engineer @Meta

Session Cloud Architecture

Survival Strategies for the Noisy Neighbor Apocalypse

Wednesday Jun 14 / 05:25PM EDT

Noisy neighbor issues are a common challenge for multi-tenant platforms, leading to resource contention, performance degradation, and costly downtime for other tenants sharing the same resources.

Speaker image - Meenakshi Jindal

Meenakshi Jindal

Staff Software Engineer @Netflix

Session

Unconference: Designing Modern Reliable Architectures

Wednesday Jun 14 / 11:50AM EDT

What is an unconference? An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions.