Software Engineer2016 - 2016Smarking
Technologies: Python, Scrapy, Requests, Selenium, PostgreSQL, Docker
- Created Scrapy pipelines to fit the existent architecture.
- Worked on several crawlers using Scrapy, Python Requests, and Selenium.
- Checked for data accuracy in the extracted data.
- Refactored internal tools for email sending using HTML templates.
Python Developer2014 - 2016Bazean
Technologies: Python, Scrapy, Django, MongoDB, PyCUDA, Elasticsearch, AngularJS, Bootstrap
- Constructed a web-scraping architecture which satisfied multiple needs and handled vague requirements.
- Developed web scrapers for multiple websites.
- Started a GPU proof of concept and a webpage for fast search of our big data.
- Planned a fully functional autocomplete solution.
- Worked on data munging and normalization.
Scala Senior Software Engineer2014 - 2015Intel
Technologies: Scala, Akka, Elasticsearch
- Developed a distributed, resilient graph-based database.
- Contributed to the overall architecture of the system; providing a solution to complex concurrency problems.
- Created tools that aggregated data into represented knowledge.
- Created Elasticsearch's asynchronous data-streaming driver with Scala.
Python Developer2012 - 2012El Portal Unico
Technologies: Python, Mechanize, Django, Bootstrap
- Modified and debugged a programmatic web browser based on Mechanize.
- Developed a web application for data visualization.
- Worked on normalization tools for ingested data.
- Developed scrapers for different websites using our own tools.