Mehmet Dogan, Data Engineer and Full-stack Web Developer in Katy, TX, United States
Mehmet Dogan

Data Engineer and Full-stack Web Developer in Katy, TX, United States

Member since December 16, 2021
Mehmet is a seasoned data engineer and full-stack web developer with years of experience working with Python on back-end engineering projects and some DevOps. He also has a lot of teaching, tutoring, and mentoring experience. Earlier in his career in the public education sector, Mehmet has hired, trained, and led teams of up to 50 people.
Mehmet is now available for hire

Portfolio

  • Flexion
    Python, AWS, Terraform, Jenkins, Docker, AWS ECS
  • ThetaCore
    Django, Django REST Framework, Google Cloud, PgBouncer, Vue
  • Edgle LLC
    Python, Django, JavaScript, D3.js, DataTables, Amazon EC2, uWSGI, NGINX...

Experience

Location

Katy, TX, United States

Availability

Full-time

Preferred Environment

PyCharm, Slack, Windows, MacOS, Ubuntu

The most amazing...

...project I've developed is a business intelligence and data analytics dashboard for Texas schools.

Employment

  • Full-stack Data Engineer

    2020 - PRESENT
    Flexion
    • Built data pipelines and workflows. Scheduled and maintained jobs.
    • Optimized Jenkins builds by creating custom Docker images.
    • Used and introduced Jupyter Notebook to the outreach team.
    • Helped build and maintain a central analytics database for Medicare.
    • Reached out to other teams to improve coordination.
    Technologies: Python, AWS, Terraform, Jenkins, Docker, AWS ECS
  • Senior Back-end Engineer

    2020 - 2020
    ThetaCore
    • Developed APIs that would be used by the front-end web application.
    • Helped the front-end team and maintained coordination.
    • Collaborated with the DevOps team to optimize and monitor the performance of the infrastructure and the API.
    Technologies: Django, Django REST Framework, Google Cloud, PgBouncer, Vue
  • Founder, Full-stack Web Developer

    2016 - 2018
    Edgle LLC
    • Collected all public education data from multiple sources and built pipelines.
    • Created a single-page front-end web application using JavaScript.
    • Built data visualizations using D3.js and many custom graphics to visualize hierarchical data and interact with it: mark, set goals, and more.
    • Developed a back-end application with Django that runs on EC2 instances.
    • Performed advertisement, contract management, and clients support.
    Technologies: Python, Django, JavaScript, D3.js, DataTables, Amazon EC2, uWSGI, NGINX, Linux, Git, Bash
  • Software Developer

    2014 - 2015
    Harmony Public Schools
    • Built a hiring workflow that would effectively communicate progress and coordinate between stakeholders in a complex business environment.
    • Generated PDF documents and developed an electronic signature system.
    • Developed and maintained the production environment with high availability and on-premise hardware.
    Technologies: PHP, CakePHP

Experience

  • School Data Dashboard | School Improvement, Educational Business Intelligence

    This dashboard significantly reduced the needs assessment effort and planning by gathering all the data needed to one location. It collects data from public sources—thousands of CSV and Excel files—and stores them in relational form for all Texas schools. Upon request, each school has around 3,000 data points pulled from the database in JSON in 0.5 seconds, including history, reference data, related data, and statistics. The data is then put in a graph structure and represented with custom D3.js visualizations as a single page application. Noteworthy features include:
    • XML parsing
    • Collect data from students, parents, and staff via surveys
    • An intuitive interface to explore hierarchical data—broken down by subject, grade, demographic, and more—in a top-to-bottom approach
    • Rate, filter, sort, take notes on, and set targets for data while adding to plan for further action
    • Concurrently exploration of data from multiple sets (i.e., multiple graph structures) by area.
    • A reusable role-based authorization app for Django tied to users’ school positions
    • Custom release management and deployment scripts in Bash
    • Single sign-on with a discourse site
    • Python unit testing, reusable Django detail views (CRUD), guided tour, and more

  • Data Pipelines with AWS Glue

    A data pipeline that extracts, transforms, and loads around 10TB of initial data from a Teradata instance to a Vertica instance using AWS Glue. Subsequent, scheduled jobs would bring about 100 million records weekly to update the data.

Skills

  • Languages

    Python, JavaScript, Bash, PHP, C, C++, Assembly
  • Tools

    PyCharm, Slack, Terraform, Jenkins, AWS ECS, PgBouncer, DataTables, uWSGI, NGINX, Git, AWS Athena, AWS Glue
  • Storage

    PostgreSQL, Google Cloud, MySQL, Redshift, Vertica, Teradata
  • Frameworks

    Django, Django REST Framework, CakePHP
  • Libraries/APIs

    Vue, D3.js, PySpark
  • Platforms

    Docker, Amazon EC2, Linux, Windows, MacOS, Ubuntu
  • Other

    AWS, Computer Vision

Education

  • Master's Degree in Electrical and Computer Engineering
    2002 - 2004
    Texas Tech University - Lubbock, Texas, US
  • Bachelor's Degree in Electrical and Computer Engineering
    1997 - 2001
    Bosphorus University - Istanbul, Turkey

To view more profiles

Join Toptal
Share it with others