Amar is available for hire

Amar Flora

Verified Expert in Engineering

Data Engineer and Software Developer

Toronto, ON, Canada

Toptal member since April 8, 2024

Expertise

Software Development Data Engineering SQL Spark Hadoop Scala Databricks Apache Airflow

Bio

Amar is a data engineer with expertise in various sectors, including railway systems, banking, health insurance, and technology. Proficient in navigating on-premise and cloud environments, particularly AWS and Azure platforms, he excels at converting complex data into coherent and actionable intelligence. Amar's work is a testament to the power of blending technology with insight, which makes him an integral force in driving the digital transformation landscape.

Portfolio

Infinity Tech

Spark, Scala, Data Engineering, PySpark, SQL, Hadoop...

Experience

Software Development - 16 years
Data Engineering - 14 years
SQL - 10 years
Spark - 8 years
PySpark - 8 years
Cloudera - 5 years
Hortonworks Data Platform (HDP) - 5 years
Databricks - 4 years

Availability

Part-time

Preferred Environment

Software Development, Spark, PySpark, AWS CLI, Hadoop, SQL, Azure, NiFi, Apache Airflow, Databricks

The most amazing...

...thing I've crafted is a real-time train app that improved safety and efficiency and earned the Canadian National Railways "Best Project" award.

Work Experience

Senior Data Engineer

2015 - PRESENT

Infinity Tech

Migrated complex on-premise infrastructure to AWS, leveraging tools like Terraform, AWS Lambda, and Amazon RDS to ensure seamless transition, scalability, and enhanced security while fulfilling strict performance standards.
Streamlined and optimized Canadian rail's data infrastructure by integrating telemetry, GIS, databases, RabbitMQ, and Kafka into a unified analytics, real-time monitoring, and decision-making system, boosting rail operations and safety.
Led a Hadoop ecosystem enhancement, integrated MapReduce, Spark/Scala, and HDFS, and refined data models and ingestion for BC Health and financial clients, boosting performance and meeting key requirements.
Secured Royal Bank of Canada's HR and financial data migration with encryption, masking, and access controls, enhancing integrity and compliance in a modern architecture for strategic analytics.

Technologies: Spark, Scala, Data Engineering, PySpark, SQL, Hadoop, Hortonworks Data Platform (HDP), Cloudera, AWS CLI, EMR, Azure, Databricks, Oozie

Experience

Canadian Rail Real-time Train Analytics

Led a major initiative to streamline and optimize Canadian rail's data infrastructure by designing and executing a comprehensive migration and transformation strategy that integrated complex and varied data sources such as locomotive telemetry, GIS, traditional databases, RabbitMQ, and Kafka. The project aimed to unify these diverse data streams into a single, efficient system capable of supporting advanced analytics, real-time monitoring, and strategic decision-making. This significantly enhanced rail operations and safety.

Education

2005 - 2008

Bachelor's Degree in Computer Engineering

Coventry University - Coventry, England, UK

Skills

Libraries/APIs

PySpark

Tools

Apache NiFi, AWS CLI, Cloudera, Oozie, Apache Airflow

Languages

SQL, Scala

Frameworks

Spark, Hadoop

Platforms

Azure, Databricks, Hortonworks Data Platform (HDP)

Other

Software Development, Data Engineering, NiFi, EMR, Telecom Equipment & Solutions

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

Share your needs

Discuss your requirements and refine your scope in a call with a Toptal domain expert.

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.

Start your risk-free talent trial

Work with your chosen talent on a trial basis for up to two weeks. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring