Dan Diamond, Developer in Lafayette, United States
Dan is available for hire
Hire Dan

Dan Diamond

Verified Expert  in Engineering

Data Engineer Developer

Lafayette, United States
Toptal Member Since
July 13, 2022

Dan is the director of management information systems at a mental health center of 500 employees, overseeing the organization's data warehousing, data analysis, and BI resources. He specializes in engineering data pipelines with Alteryx, Python, PHP, and BI tools. Dan implemented predictive analytics systems using Python and R in the areas of employee sentiment, patient outcomes, and crisis intervention.


Valley Oaks Health
C#, Dundas BI, Python, R, PHP, Analysis, Jupyter Notebook, SQL, Databases...
Valley Oaks Health
Dundas BI, Python, PHP, T-SQL (Transact-SQL), MySQL, Analysis, Jupyter Notebook...
Alteryx, JasperReports, Python, ETL, PostgreSQL, DbVisualizer...




Preferred Environment

Windows, Anaconda, Jupyter, Visual Studio, R, Python

The most amazing...

...thing I've developed is a predictive analytics system to identify the most important features in predicting positive patient outcomes.

Work Experience

Director of Management Information Systems

2022 - PRESENT
Valley Oaks Health
  • Developed data collection interface for TB test for the nursing department, allowing convenient reporting of staff compliance and supporting TB test administration workflows.
  • Managed a team of seven employees—two developers, one electronic health record admin, one systems admin, two technicians, and a secretary. Improved team productivity, communication, and collaboration.
  • Oversaw data migration process in transition to a new electronic health record. Provided support and supervision, advising on ETL challenges.
Technologies: C#, Dundas BI, Python, R, PHP, Analysis, Jupyter Notebook, SQL, Databases, Data Analytics, Data Visualization, Data Engineering

Assistant Director of Management Information Systems

2021 - 2022
Valley Oaks Health
  • Built the ETL pipeline, integrating disparate HR and budget data sources, assisting the controller in developing the next fiscal year budget, and providing detailed estimates of cost and revenue per employee FTE.
  • Collaborated with, advised, and reported directly to the chief operating officer in developing KPIs and reports. Assisted with translating business problems into readable, understandable, actionable data visualizations and reports.
  • Developed spreadsheets for leadership to estimate the impact on revenue due to slight changes in staff productivity expectations.
  • Created and automated reports analyzing trends in referral sources and their impact on various patient risk groups. Advised leadership committee on the impact of COVID-19 on referrals, as evidenced by data.
  • Coordinated a team of seven employees in relocating a residential program to a new facility, acting as liaison with residential, housekeeping, and maintenance teams. Assisted with planning and nurturing positive interdepartmental communication.
  • Developed the ETL pipeline, engineered features, and produced reporting and analysis of patient access data. This analysis improved the integrity of staff processes and documentation and provided insights into referral outcomes.
Technologies: Dundas BI, Python, PHP, T-SQL (Transact-SQL), MySQL, Analysis, Jupyter Notebook, SQL, Machine Learning, Databases, Predictive Modeling, Data Visualization, Data Engineering

Data Engineer III

2021 - 2021
  • Automated the process of dumping data integrity reports into the Excel format used by engineers to review ingestion and project planning.
  • Assisted with the testing of proprietary tools for processing and stitching PDF files.
  • Engineered the process to stitch, move, and rename over 12 million PDF reports from four separate ingestion processes, eliminating duplicates and flagging ingestion errors.
  • Collaborated with a team of ten engineers, helping other engineers to develop SQL and Python skills.
  • Developed and formatted reporting for HR and clinical applications into an integrated interface.
Technologies: Alteryx, JasperReports, Python, ETL, PostgreSQL, DbVisualizer, SQL Server Management Studio (SSMS), Jupyter Notebook, SQL, Databases, Data Analytics, Data Engineering

Data Analyst

2020 - 2021
Salud Revenue Partners
  • Implemented the Erlang formulas to estimate staffing pattern needs for call center staff. Produced visualizations that identified optimal patterns.
  • Built a pipeline to clean and warehouse data from the company's call system software, improving analysis and performance tracking opportunities.
  • Developed the process to check pipeline data integrity and evaluate metrics from legacy SSRS report.
  • Engineered the data feature to map the path of call center calls and developed reporting to evaluate the efficiency and effectiveness of calling campaigns.
Technologies: Analysis, Python, R, Jupyter Notebook, SQL, Databases, Data Analytics, Predictive Modeling, Data Visualization

Data Analyst | BI Developer

2018 - 2021
Valley Oaks Health
  • Built the HR dashboards visualizing turnover and hire data, current manning table and open roles, and employee segmentation.
  • Developed the weekly COVID-19 spread rate and resource use report, integrating the current data from state reporting API.
  • Maintained the data warehouse tables and code for warehouse and socket server processes, updating for changes in the state reporting system and internal reporting needs.
  • Developed surveys in SurveyMonkey and produced analyses for employee job satisfaction, engagement, patient satisfaction, and culture of equity. Visualized data in Python and applied Tukey means comparison to support leadership decisions.
Technologies: Python, R, Regression, Analysis of Variance (ANOVA), Dundas BI, PHP, MySQL, SQL Server Management Studio (SSMS), Teams, Zoom, APIs, Analysis, Jupyter Notebook, SQL, Machine Learning, Databases, Data Analytics, Data Visualization

Programmer | Analyst

2017 - 2018
Valley Oaks Health
  • Built a predictive analytics system, analyzing and identifying the most important features for patient outcomes, crisis calls, and employee experience sentiments.
  • Co-developed sync process in PHP to warehouse cloud electronic health record data in an on-premise warehouse, ensuring proper encoding and data integrity.
  • Developed a socket server program in C# to communicate patient and service data to the state system consuming SOAP API. This service salvaged legacy PHP code that was no longer compatible with the state interface saving other devs refactoring.
  • Designed and produced SurveyMonkey surveys, including collecting staff exit interview data. Created dashboard for HR staff to perform analysis.
  • Developed visualizations in R, assisting HR in identifying trends and hot spots in organizational turnover.
Technologies: R, Python, PHP, C#, Algorithms, Data Wrangling, Dundas BI, Data Cleaning, Data Warehousing, Analysis, Jupyter Notebook, SQL, MySQL, Databases, Data Visualization

Program Coordinator

2004 - 2017
Valley Oaks Health
  • Supervised a team of as many as 20 employees in a 24-hour psychiatric residential environment, including recruiting, interviewing, hiring, training, managing, and firing.
  • Provided training and supervision for completing clinical documentation, observing HIPAA, accreditation, and internal standards for handling PHI data.
  • Prepared and managed annual budget and staffing pattern needs, always coming in under budget.
  • Increased billing revenues by over 400% while improving clinical care and staff job satisfaction.
  • Implemented an 84-step decision tree for handling emergency calls and supervised the after-hours call service.
  • Wrote and revised 60 department policies and procedures, working collaboratively with stakeholders and ensuring adherence to HIPAA and accreditation standards and clinical best practices.
  • Cultivated robust collaborative relationships with the IT departments, psychiatrists, therapists, nurses, administrative staff, housekeeping, and maintenance departments.
Technologies: Team Leadership, Communication, Collaboration

State Reporting Socket Server

Upgrades to the state's system for reporting patient episodes and services were incompatible with the company's legacy code. We needed a way to continue automating reporting, ideally without re-implementing the complicated reporting logic.

I developed a socket server program in C# with a library of translation functions that abstracted away from the state system's new, object-oriented, SOAP API standards, allowing continued use of legacy PHP code. It saved the company the cost of re-implementation, improved reporting accuracy, enabled the full use of all provided API functions, and enhanced reliability via robust exception handling.

Patient Outcome and Staff Sentiment Predictive Modeling

An analysis of patient assessment data and staff exit interview data in R.

I completed feature engineering, applied machine learning algorithms with hyperparametric tuning, compared and selected models, and identified the most critical features predicting positive staff sentiment about their employment experience and those predicting changes in patient scores on depression and other functional assessment scales.
2019 - 2019

Graduate Certificate in Applied Statistics

Penn State University - Malvern, University Park, PA, USA

2017 - 2018

Master's Degree in Data Analytics

Penn State University - Malvern, University Park, PA, USA

2013 - 2017

Bachelor's Degree in Computer Science

Florida State University - Panama City, FL, USA

1990 - 1995

Bachelor's Degree in Physics

Purdue University - West Lafayette, IN, USA


SAS Basic Programmer Certification



Actuarial Exam P/1—Probability

Society of Actuaries


Sockets, JasperReports


Dundas BI, Jupyter, Visual Studio, Zoom, DbVisualizer


ETL, Object-oriented Programming (OOP), Database Design


Python, T-SQL (Transact-SQL), PHP, SQL, C++, Java, C, Assembly Language, R, SAS, C#


Anaconda, Jupyter Notebook, Linux, KNIME, Oracle, Windows, Alteryx


Databases, MySQL, PostgreSQL, SQL Server Management Studio (SSMS)




Analysis, Data Cleaning, Data Visualization, Data Analytics, Complex Problem Solving, Predictive Analytics, APIs, Predictive Modeling, Data Engineering, Mathematics, Mechanics, Algorithms, Data Structures, Software Engineering, Programming Languages, Research, Data Mining, Machine Learning, Feature Selection, Statistics, Data Collection, Analysis of Variance (ANOVA), Linear Regression, Minitab, Data Wrangling, Data Warehousing, Regression, Calculus, Probability Theory, SOAP, Teams, Team Leadership, Communication, Collaboration

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.


Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring