Cliff Crosland, Developer in San Francisco, CA, United States
Cliff is available for hire
Hire Cliff

Cliff Crosland

Verified Expert  in Engineering

Software Developer

Location
San Francisco, CA, United States
Toptal Member Since
October 18, 2017

Cliff is a full-stack software engineer who has had the opportunity to work on some remarkable technology, including systems to crawl the web and process hundreds of millions of extracted profiles from web-pages. He's passionate about building elegant APIs and processing systems as well as beautiful front-end web experiences.

Portfolio

Accompany
ClojureScript, Amazon DynamoDB, PostgreSQL, C++, Ruby on Rails (RoR), Ruby
Seed Equity
Microsoft SQL Server, PostgreSQL, C#, Angular, Node.js
Addepar
MySQL, Scala, Java

Experience

Availability

Part-time

Preferred Environment

Git, Vim Text Editor, Linux, Unix, MacOS

The most amazing...

...thing I've built is an infrastructure to download millions of web pages and extract hundreds of millions of person and company profiles from raw HTML documents.

Work Experience

Software Engineer

2015 - PRESENT
Accompany
  • Scaled the throughput of the main data ingestion pipeline from a rate of a few hundred thousand profile objects per week to over a hundred million profile objects per week by introducing an internal framework to parallelize tasks running in Ruby on Rails and Resque.
  • Optimized data access patterns at scale, moving data as needed from PostgreSQL to DynamoDB for better write performance.
  • Built a C++ extraction system to analyze raw HTML documents and intelligently extract structured person profiles, using consensus signals from our data to detect high-quality matches.
  • Designed and built a search back-end using Algolia for fuzzy text search and advanced facet search and built web front-end components using Reagent (a ClojureScript React wrapper) to highlight notable search results.
  • Designed and implemented AWS server topology for the data processing pipeline, using AWS components like EC2, RDS, DynamoDB, and ELB and integrated monitoring services like New Relic, Grafana, Pingdom, and PagerDuty.
  • Built an email system for sending personalized news and event notifications to users and integrated analytics systems like Mandrill and Amplitude to optimize open rates.
Technologies: ClojureScript, Amazon DynamoDB, PostgreSQL, C++, Ruby on Rails (RoR), Ruby

CTO | Co-Founder

2013 - 2015
Seed Equity
  • Led the technology team for the seed equity crowd-funding platform, implementing the majority of the functionality, and led a team of two other engineers.
  • Designed and implemented dynamically scaling micro-services written in Node.js and C#.
  • Built the front-end web user-experience using Angular.
  • Designed and implemented our AWS server topology, using EC2, RDS, Elastic Beanstalk, Elasticache, S3, and CloudFront.
  • Built the data layer powering the web experience using PostgreSQL, SQL Server, as well as integration with third-party secure document storage to comply with financial regulations.
Technologies: Microsoft SQL Server, PostgreSQL, C#, Angular, Node.js

Software Engineer

2012 - 2013
Addepar
  • Built and shipped Addepar's financial platform to beta customers in the venture capital industry.
  • Designed graph-based models and financial algorithms for venture capital financial structures.
  • Created native desktop UI in Java Swing to allow venture capital customers to build interactive reports.
  • Built backend financial data processing engine in Java and Scala to rapidly compute financial ownership positions.
  • Designed efficient data access patterns in MySQL to store financial graph data.
Technologies: MySQL, Scala, Java

Accompany Data Pipeline

https://app.accompany.com
Built an infrastructure to download millions of web pages and extract hundreds of millions of person and company profiles from raw HTML documents.

Wrote task processors in Ruby and C++.

Managed hundreds of millions of objects in our storage system—consisting of PostgreSQL, DynamoDB, and S3.

Designed and implemented Accompany's typeahead and advanced facet search system using a hybrid of Algolia and PostgreSQL.

Black-Hole.js | Render Gravitational Lensing in a Browser

https://github.com/cliffcrosland/black-hole.js
A JavaScript library that renders black hole gravitational lensing effects in an image canvas using WebGL, glfx.js, and Numeric.js.

The library uses a numerical ordinary differential equation solver from Numeric.js, and some nice WebGL utilities from glfx.js, to render the gravitational lensing of a black hole.

You can read more about the project and the fun challenges it posed in my write-up here at the link.

Languages

JavaScript, Ruby, Python 3, C++, Clojure, Java, Scala, C#

Frameworks

Ruby on Rails (RoR), Pyramid, Django, Angular, ClojureScript

Libraries/APIs

React, Node.js

Tools

Vim Text Editor, Git

Storage

PostgreSQL, MySQL, Redis, Microsoft SQL Server, Amazon DynamoDB

Other

Software Development

Paradigms

Functional Programming

Platforms

Linux, MacOS, Unix

2006 - 2012

Bachelor of Science in Computer Science

Stanford University - Palo Alto, CA, USA

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring