Software Engineer
2015 - PRESENTAccompany- Scaled the throughput of the main data ingestion pipeline from a rate of a few hundred thousand profile objects per week to over a hundred million profile objects per week by introducing an internal framework to parallelize tasks running in Ruby on Rails and Resque.
- Optimized data access patterns at scale, moving data as needed from PostgreSQL to DynamoDB for better write performance.
- Built a C++ extraction system to analyze raw HTML documents and intelligently extract structured person profiles, using consensus signals from our data to detect high-quality matches.
- Designed and built a search back-end using Algolia for fuzzy text search and advanced facet search and built web front-end components using Reagent (a ClojureScript React wrapper) to highlight notable search results.
- Designed and implemented AWS server topology for the data processing pipeline, using AWS components like EC2, RDS, DynamoDB, and ELB and integrated monitoring services like New Relic, Grafana, Pingdom, and PagerDuty.
- Built an email system for sending personalized news and event notifications to users and integrated analytics systems like Mandrill and Amplitude to optimize open rates.
Technologies: ClojureScript, Amazon DynamoDB, PostgreSQL, C++, Ruby on Rails (RoR), RubyCTO | Co-Founder
2013 - 2015Seed Equity- Led the technology team for the seed equity crowd-funding platform, implementing the majority of the functionality, and led a team of two other engineers.
- Designed and implemented dynamically scaling micro-services written in Node.js and C#.
- Built the front-end web user-experience using Angular.
- Designed and implemented our AWS server topology, using EC2, RDS, Elastic Beanstalk, Elasticache, S3, and CloudFront.
- Built the data layer powering the web experience using PostgreSQL, SQL Server, as well as integration with third-party secure document storage to comply with financial regulations.
Technologies: Microsoft SQL Server, PostgreSQL, C#, Angular, Node.jsSoftware Engineer
2012 - 2013Addepar- Built and shipped Addepar's financial platform to beta customers in the venture capital industry.
- Designed graph-based models and financial algorithms for venture capital financial structures.
- Created native desktop UI in Java Swing to allow venture capital customers to build interactive reports.
- Built backend financial data processing engine in Java and Scala to rapidly compute financial ownership positions.
- Designed efficient data access patterns in MySQL to store financial graph data.
Technologies: MySQL, Scala, Java
Cliff Crosland
Software Developer in San Francisco, CA, United States
Member since October 18, 2017
Cliff is a full-stack software engineer who has had the opportunity to work on some remarkable technology, including systems to crawl the web and process hundreds of millions of extracted profiles from web-pages. He's passionate about building elegant APIs and processing systems as well as beautiful front-end web experiences.
Cliff is now available for hire
Portfolio
- AccompanyClojureScript, Amazon DynamoDB, PostgreSQL, C++, Ruby on Rails (RoR), Ruby
- Seed EquityMicrosoft SQL Server, PostgreSQL, C#, Angular, Node.js
- AddeparMySQL, Scala, Java
Experience
- Ruby 5 years
- JavaScript 5 years
- Ruby on Rails (RoR) 5 years
- PostgreSQL 5 years
- React 2 years
Availability
Part-time
Preferred Environment
Git, Vim Text Editor, Linux, Unix, MacOS
The most amazing...
...thing I've built is an infrastructure to download millions of web pages and extract hundreds of millions of person and company profiles from raw HTML documents.
Employment
Experience
- Accompany Data Pipelinehttps://app.accompany.com
Built an infrastructure to download millions of web pages and extract hundreds of millions of person and company profiles from raw HTML documents.
Wrote task processors in Ruby and C++.
Managed hundreds of millions of objects in our storage system—consisting of PostgreSQL, DynamoDB, and S3.
Designed and implemented Accompany's typeahead and advanced facet search system using a hybrid of Algolia and PostgreSQL. - Black-Hole.js | Render Gravitational Lensing in a Browserhttps://github.com/cliffcrosland/black-hole.js
A JavaScript library that renders black hole gravitational lensing effects in an image canvas using WebGL, glfx.js, and Numeric.js.
The library uses a numerical ordinary differential equation solver from Numeric.js, and some nice WebGL utilities from glfx.js, to render the gravitational lensing of a black hole.
You can read more about the project and the fun challenges it posed in my write-up here at the link.
Skills
Languages
JavaScript, Ruby, Python 3, C++, Clojure, Java, Scala, C#Frameworks
Ruby on Rails (RoR), Pyramid, Django, Angular, ClojureScriptLibraries/APIs
React, Node.jsTools
Vim Text Editor, GitStorage
PostgreSQL, MySQL, Redis, Microsoft SQL Server, Amazon DynamoDBOther
Software DevelopmentParadigms
Functional ProgrammingPlatforms
Linux, MacOS, Unix
Education
- Bachelor of Science in Computer Science2006 - 2012Stanford University - Palo Alto, CA, USA
