Duarte Nunes
Verified Expert in Engineering
Distributed Systems Developer
Campinas - State of São Paulo, Brazil
Toptal member since July 4, 2020
Duarte has been working as a software developer for over 10 years, with the bulk of his experience in infrastructure software, mainly distributed and low-latency software. Recently, he was a distinguished engineer at ScyllaDB, building the world's fastest NoSQL database, and then the CTO of vectorized.io, writing a drop-in replacement for Apache Kafka with 10x the throughput. Duarte has most recently co-founded a company using web technologies like React and GraphQL.
Portfolio
Experience
- Distributed Databases - 6 years
- NoSQL - 6 years
- Distributed Systems - 6 years
- Full-stack - 2 years
- Amazon Web Services (AWS) - 2 years
- React - 2 years
- Rust - 1 year
Availability
Preferred Environment
Visual Studio Code (VS Code)
The most amazing...
...thing I've developed is an algorithm for having materialized views in a distributed data store.
Work Experience
CTO
Umani
- Created a personal project using a serverless architecture on AWS. The back end is Lambdas written in Go and the front end is a React SPA, connected by a GraphQL API. Infrastructure is defined as code using the AWS CDK.
- Defined and implemented a serverless architecture based on event sourcing, using AWS AppSync, DynamoDB, DynamoDB streams, S3 and Lambda.
- Implemented a custom-made component system for the front end, available at http://storybook.dev.uma.ni.
Chief Technology Officer
Vectorized.io
- Developed the initial infrastructure for Redpanda, a Kafka API-compatible, transactional, and safe queue, intended for massive data streams. It's built on top of the Seastar project, an advanced C++ framework for high-performance server applications.
- Built the storage module, a distributed append-only log.
- Developed an implementation of the Raft algorithm with two important characteristics: each node implemented many Raft instances and coalesced heartbeats; the Raft log was the storage log itself.
Software Engineer
ScyllaDB
- Contributed to ScyllaDB, a high-performance NoSQL database compatible with Apache Cassandra, optimized for modern hardware, and the underlying Seastar project, an advanced C++ framework for high-performance server applications.
- Developed several cross-cutting features including range tombstones, thrift support, materialized views, and Raft and lightweight transactions.
- Reviewed contributions to multiple components of the system, enforcing correctness and architectural constraints.
Software Engineer
Midokura
- Worked as a software engineer on MidoNet, a virtual network platform for IaaS clouds. Focused on the architecture and implementation of the core network controller, a distributed and highly concurrent software written in Java and Scala.
- Improved performance and scalability (e.g., measuring and accelerating the packet processing pipeline, reducing memory footprint, scaling the on-ramp and off-ramp gateways, re-write of the userspace NetLink library, and more).
- Defined and implemented cross-controller features, namely the distributed flow state management algorithm.
Experience
ScyllaDB
https://github.com/scylladb/scyllaEducation
Bachelor's Degree in Computer Science
Instituto Superior de Lisboa - Lisbon, Portugal
Skills
Libraries/APIs
React, Node.js
Tools
AWS AppSync, Bazel
Languages
C++, Java, TypeScript, Go, Scala, Rust, GraphQL
Paradigms
Asynchronous Programming
Platforms
AWS Lambda, Linux, Apache Kafka, Amazon Web Services (AWS), OpenStack, Docker, Visual Studio Code (VS Code)
Storage
NoSQL, Distributed Databases, Databases, Amazon DynamoDB, Amazon S3 (AWS S3)
Frameworks
Seastar Framework
Other
Apache Cassandra, Full-stack, Distributed Systems, Software Architecture, Storage
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring