Andrew Collier, Web Scraping Developer in Durban, KwaZulu-Natal, South Africa
Andrew Collier

Web Scraping Developer in Durban, KwaZulu-Natal, South Africa

Member since February 7, 2016
Andrew picked up skills in programming and data analysis while working as a space physicist. For the last few years, he's been engaged as a data scientist working predominantly in R and Python, with a good measure of SQL thrown in.
Andrew is now available for hire




Durban, KwaZulu-Natal, South Africa



Preferred Environment

RStudio, Jupyter, Git, Linux, Bash

The most amazing...

...system I've developed has been running autonomously in Antarctica for over a decade.


  • Founder/Data Scientist

    2017 - PRESENT
    Exegetic Analytics
    • Cleaned, prepared, and analyzed data.
    • Built machine learning models.
    • Optimized software.
    • Automated documentation.
    • Developed and managed packages.
    • Prepared and gave lectures and presentations.
    • Built data products (APIs and Shiny apps).
    Technologies: R, Python, SQL, Linux
  • Founder/Data Scientist

    2008 - PRESENT
    Exegetic Analytics
    • Conducted data analyses for clinical trials.
    • Developed a conformance analysis system for use in printing industry.
    • Implemented a Kagi Charts indicator in MQL4.
    • Conducted analysis of the effects of news events on FOREX trading using data scraped off myfxbook.
    • Initiated Durban R User Group and Durban Data Science Meetup.
    Technologies: R, Python, SQL, Linux
  • Senior Data Scientist

    2013 - 2017
    • Coded a game recommendation engine.
    • Developed a game/player anomaly detection system.
    • Automated routine analyses.
    • Automated report generation.
    • Initiated Data Science Working Group.
    Technologies: R, Python, SQL, Excel, Linux
  • Honorary Senior Lecturer

    2004 - 2015
    University of KwaZulu-Natal
    • Developed an autonomous observation system for experiments in Antarctica.
    • Applied machine learning techniques to lightning distributions.
    • Mentored students in R and data analysis.
    • Presented analytical results at numerous international conferences.
    • Published research results in international journals.
    Technologies: R, Octave, Matlab, Linux


  • Scientific Advisor (Other amazing things)

    Supervised two Ph.D. and numerous M.Sc. theses in the field of space physics.

  • Toptal Mentor
    Andrew is a mentor in the Toptal Global Mentor’s Program. This program is a partnership between Toptal and General Assembly to provide high quality mentorship for students from minority and low income backgrounds who are looking to begin their careers as professional software engineers. Andrew shows commitment to diversity in tech by mentoring a General Assembly student every week for a year, covering everything from coding tips and tricks to advice on making it in the industry.


  • Platforms

    Linux, Docker
  • Other

    Web Scraping, Machine Learning, Task Automation, Regular Expressions, Visualization, Physics Simulations, Applied Mathematics, Math (Geometry/Trigonometry), Mathematics, Statistics, Data Analysis, Bayesian Statistics
  • Languages

    SQL, Bash, R, C++, Python, CSS, HTML, Sed
  • Tools

    Microsoft Excel
  • Paradigms

    Automation, Data Science
  • Frameworks

    Django, RStudio Shiny
  • Storage

    MongoDB, Neo4j


  • Ph.D. degree in Space Physics
    2001 - 2006
    Royal Institute of Technology - Stockholm, Sweden
  • M.Sc. degree in Nuclear Physics
    1996 - 1998
    University of Potchefstroom - Potchefstroom, South Africa
  • B.Sc. (Hons) degree in Physics & Mathematics
    1990 - 1993
    University of Natal - Durban, South Africa
  • PhD
    JUNE 2006 - PRESENT
    Royal Institute of Technology

To view more profiles

Join Toptal
I really like this profile
Share it with others