Dan is currently unavailable
Dan Diamond
Verified Expert in Engineering
Data Engineer Developer
Lafayette, United States
Toptal member since July 13, 2022
Bio
Dan is the director of management information systems at a mental health center of 500 employees, overseeing the organization's data warehousing, data analysis, and BI resources. He specializes in engineering data pipelines with Alteryx, Python, PHP, and BI tools. Dan implemented predictive analytics systems using Python and R in the areas of employee sentiment, patient outcomes, and crisis intervention.
Portfolio
Valley Oaks Health
C#, Dundas BI, Python, R, PHP, Analysis, Jupyter Notebook, SQL, Databases...
Valley Oaks Health
Dundas BI, Python, PHP, Transact-SQL (T-SQL), MySQL, Analysis, Jupyter Notebook...
Clearsense
Alteryx, JasperReports, Python, ETL, PostgreSQL, DbVisualizer...
Experience
- Analysis - 5 years
- Databases - 4 years
- Python - 4 years
- Data Cleaning - 4 years
- ETL - 4 years
- Data Visualization - 4 years
- Jupyter - 3 years
- R - 1 year
Preferred Environment
Windows, Anaconda, Jupyter, Visual Studio, R, Python
The most amazing...
...thing I've developed is a predictive analytics system to identify the most important features in predicting positive patient outcomes.
Work Experience
Director of Management Information Systems
2022 - PRESENT
Valley Oaks Health
- Developed data collection interface for TB test for the nursing department, allowing convenient reporting of staff compliance and supporting TB test administration workflows.
- Managed a team of seven employees—two developers, one electronic health record admin, one systems admin, two technicians, and a secretary. Improved team productivity, communication, and collaboration.
- Oversaw data migration process in transition to a new electronic health record. Provided support and supervision, advising on ETL challenges.
Technologies: C#, Dundas BI, Python, R, PHP, Analysis, Jupyter Notebook, SQL, Databases, Data Analytics, Data Visualization, Data Engineering, Reports, Business Intelligence (BI), Microsoft SQL Server
Assistant Director of Management Information Systems
2021 - 2022
Valley Oaks Health
- Built the ETL pipeline, integrating disparate HR and budget data sources, assisting the controller in developing the next fiscal year budget, and providing detailed estimates of cost and revenue per employee FTE.
- Collaborated with, advised, and reported directly to the chief operating officer in developing KPIs and reports. Assisted with translating business problems into readable, understandable, actionable data visualizations and reports.
- Developed spreadsheets for leadership to estimate the impact on revenue due to slight changes in staff productivity expectations.
- Created and automated reports analyzing trends in referral sources and their impact on various patient risk groups. Advised leadership committee on the impact of COVID-19 on referrals, as evidenced by data.
- Coordinated a team of seven employees in relocating a residential program to a new facility, acting as liaison with residential, housekeeping, and maintenance teams. Assisted with planning and nurturing positive interdepartmental communication.
- Developed the ETL pipeline, engineered features, and produced reporting and analysis of patient access data. This analysis improved the integrity of staff processes and documentation and provided insights into referral outcomes.
Technologies: Dundas BI, Python, PHP, Transact-SQL (T-SQL), MySQL, Analysis, Jupyter Notebook, SQL, Machine Learning, Databases, Predictive Modeling, Data Visualization, Data Engineering, Reports, Business Intelligence (BI), Microsoft SQL Server
Data Engineer III
2021 - 2021
Clearsense
- Automated the process of dumping data integrity reports into the Excel format used by engineers to review ingestion and project planning.
- Assisted with the testing of proprietary tools for processing and stitching PDF files.
- Engineered the process to stitch, move, and rename over 12 million PDF reports from four separate ingestion processes, eliminating duplicates and flagging ingestion errors.
- Collaborated with a team of ten engineers, helping other engineers to develop SQL and Python skills.
- Developed and formatted reporting for HR and clinical applications into an integrated interface.
Technologies: Alteryx, JasperReports, Python, ETL, PostgreSQL, DbVisualizer, SQL Server Management Studio (SSMS), Jupyter Notebook, SQL, Databases, Data Analytics, Data Engineering, Reports, Microsoft SQL Server
Data Analyst
2020 - 2021
Salud Revenue Partners
- Implemented the Erlang formulas to estimate staffing pattern needs for call center staff. Produced visualizations that identified optimal patterns.
- Built a pipeline to clean and warehouse data from the company's call system software, improving analysis and performance tracking opportunities.
- Developed the process to check pipeline data integrity and evaluate metrics from legacy SSRS report.
- Engineered the data feature to map the path of call center calls and developed reporting to evaluate the efficiency and effectiveness of calling campaigns.
Technologies: Analysis, Python, R, Jupyter Notebook, SQL, Databases, Data Analytics, Predictive Modeling, Data Visualization, Reports, Microsoft SQL Server
Data Analyst | BI Developer
2018 - 2021
Valley Oaks Health
- Built the HR dashboards visualizing turnover and hire data, current manning table and open roles, and employee segmentation.
- Developed the weekly COVID-19 spread rate and resource use report, integrating the current data from state reporting API.
- Maintained the data warehouse tables and code for warehouse and socket server processes, updating for changes in the state reporting system and internal reporting needs.
- Developed surveys in SurveyMonkey and produced analyses for employee job satisfaction, engagement, patient satisfaction, and culture of equity. Visualized data in Python and applied Tukey means comparison to support leadership decisions.
Technologies: Python, R, Regression, Analysis of Variance (ANOVA), Dundas BI, PHP, MySQL, SQL Server Management Studio (SSMS), Teams, Zoom, APIs, Analysis, Jupyter Notebook, SQL, Machine Learning, Databases, Data Analytics, Data Visualization, Reports, Business Intelligence (BI), Microsoft SQL Server
Programmer | Analyst
2017 - 2018
Valley Oaks Health
- Built a predictive analytics system, analyzing and identifying the most important features for patient outcomes, crisis calls, and employee experience sentiments.
- Co-developed sync process in PHP to warehouse cloud electronic health record data in an on-premise warehouse, ensuring proper encoding and data integrity.
- Developed a socket server program in C# to communicate patient and service data to the state system consuming SOAP API. This service salvaged legacy PHP code that was no longer compatible with the state interface saving other devs refactoring.
- Designed and produced SurveyMonkey surveys, including collecting staff exit interview data. Created dashboard for HR staff to perform analysis.
- Developed visualizations in R, assisting HR in identifying trends and hot spots in organizational turnover.
Technologies: R, Python, PHP, C#, Algorithms, Data Wrangling, Dundas BI, Data Cleaning, Data Warehousing, Analysis, Jupyter Notebook, SQL, MySQL, Databases, Data Visualization, Reports, Business Intelligence (BI), Microsoft SQL Server
Program Coordinator
2004 - 2017
Valley Oaks Health
- Supervised a team of as many as 20 employees in a 24-hour psychiatric residential environment, including recruiting, interviewing, hiring, training, managing, and firing.
- Provided training and supervision for completing clinical documentation, observing HIPAA, accreditation, and internal standards for handling PHI data.
- Prepared and managed annual budget and staffing pattern needs, always coming in under budget.
- Increased billing revenues by over 400% while improving clinical care and staff job satisfaction.
- Implemented an 84-step decision tree for handling emergency calls and supervised the after-hours call service.
- Wrote and revised 60 department policies and procedures, working collaboratively with stakeholders and ensuring adherence to HIPAA and accreditation standards and clinical best practices.
- Cultivated robust collaborative relationships with the IT departments, psychiatrists, therapists, nurses, administrative staff, housekeeping, and maintenance departments.
Technologies: Team Leadership, Communication, Collaboration
Experience
State Reporting Socket Server
Upgrades to the state's system for reporting patient episodes and services were incompatible with the company's legacy code. We needed a way to continue automating reporting, ideally without re-implementing the complicated reporting logic.
I developed a socket server program in C# with a library of translation functions that abstracted away from the state system's new, object-oriented, SOAP API standards, allowing continued use of legacy PHP code. It saved the company the cost of re-implementation, improved reporting accuracy, enabled the full use of all provided API functions, and enhanced reliability via robust exception handling.
I developed a socket server program in C# with a library of translation functions that abstracted away from the state system's new, object-oriented, SOAP API standards, allowing continued use of legacy PHP code. It saved the company the cost of re-implementation, improved reporting accuracy, enabled the full use of all provided API functions, and enhanced reliability via robust exception handling.
Patient Outcome and Staff Sentiment Predictive Modeling
An analysis of patient assessment data and staff exit interview data in R.
I completed feature engineering, applied machine learning algorithms with hyperparametric tuning, compared and selected models, and identified the most critical features predicting positive staff sentiment about their employment experience and those predicting changes in patient scores on depression and other functional assessment scales.
I completed feature engineering, applied machine learning algorithms with hyperparametric tuning, compared and selected models, and identified the most critical features predicting positive staff sentiment about their employment experience and those predicting changes in patient scores on depression and other functional assessment scales.
Education
2019 - 2019
Graduate Certificate in Applied Statistics
Penn State University - Malvern, University Park, PA, USA
2017 - 2018
Master's Degree in Data Analytics
Penn State University - Malvern, University Park, PA, USA
2013 - 2017
Bachelor's Degree in Computer Science
Florida State University - Panama City, FL, USA
1990 - 1995
Bachelor's Degree in Physics
Purdue University - West Lafayette, IN, USA
Certifications
JULY 2019 - PRESENT
SAS Basic Programmer Certification
SAS
JULY 2012 - PRESENT
Actuarial Exam P/1—Probability
Society of Actuaries
Skills
Libraries/APIs
Sockets, JasperReports
Tools
Dundas BI, Jupyter, Visual Studio, Zoom, DbVisualizer
Paradigms
ETL, Business Intelligence (BI), Object-oriented Programming (OOP), Database Design
Languages
Python, Transact-SQL (T-SQL), PHP, SQL, C++, Java, C, Assembly Language, R, SAS, C#
Platforms
Anaconda, Jupyter Notebook, Linux, KNIME, Oracle, Windows, Alteryx
Storage
Databases, MySQL, Microsoft SQL Server, PostgreSQL, SQL Server Management Studio (SSMS)
Frameworks
Hadoop
Other
Analysis, Data Cleaning, Data Visualization, Data Analytics, Complex Problem Solving, Predictive Analytics, APIs, Predictive Modeling, Data Engineering, Reports, Mathematics, Mechanics, Algorithms, Data Structures, Software Engineering, Programming Languages, Research, Data Mining, Machine Learning, Feature Selection, Statistics, Data Collection, Analysis of Variance (ANOVA), Linear Regression, Minitab, Data Wrangling, Data Warehousing, Regression, Calculus, Probability Theory, SOAP, Teams, Team Leadership, Communication, Collaboration
Collaboration That Works
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
1
Share your needs
Discuss your requirements and refine your scope in a call with a Toptal domain expert.
2
Choose your talent
Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3
Start your risk-free talent trial
Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.
Top talent is in high demand.
Start hiring