toptal.com
Contact us: +1.888.867.7001
Shanthi Viswanathan, Data Engineering Developer in East Brunswick, NJ, United States
Shanthi Viswanathan

Data Engineering Developer in East Brunswick, NJ, United States

Member since December 6, 2019
Shanthi has over 20 years of experience developing applications using various technologies. As an architect, she has executed several web-based applications, integrations, data migrations, data conversions, and data warehousing projects with significant hands-on as well as leadership responsibilities. She keeps up-to-date with the latest technologies and can effectively match the business needs with those technologies.
Shanthi is now available for hire
Hire Shanthi

Portfolio

  • Pfizer
    Python, R, SQL, Redshift, Lab Information Management Software (LIMS)...
  • World Health Partners
    MySQL, MongoDB, Django, Python
  • Exelon
    Apache Kafka, Hadoop, Python, Oracle Database, Informatica ETL...

Experience

Location

East Brunswick, NJ, United States

Availability

Part-time

Preferred Environment

Node.js, React, R, Python, SQL, Linux, Neo4j, Oracle

The most amazing...

...project I've designed and coded determined the price of products based on sales promotions, order quantity, location, and customer status.

Employment

  • Data Engineer

    2020 - PRESENT
    Pfizer
    • Technical architect in the development of ETLs to bring data from the Redshift data lake to project-specific Postgres and neo4j databases to represent complex relationships across different objects used for quality control.
    • Built logic to provide for restart capability in case of failures during the load. Produced several data pipelines and improved the performance of these ETLs.
    • Developed a data model to support the UI for capacity planning and schedule optimization in labs.
    • Developed ETLs to forecast demand and inspection analysis from historical data.
    Technologies: Python, R, SQL, Redshift, Lab Information Management Software (LIMS), DataGrip, Oracle SQL Developer, Atom, Neo4j, Data Architecture, Data Modeling, Kubernetes, Splunk, Apache Airflow, Tableau, PostgreSQL, Amazon Web Services (AWS)

  • Technical Manager

    2019 - 2019
    World Health Partners
    • Designed and developed a web application to be used in rural schools for capturing student performance using Python, Django, MySQL.
    • Designed the data architecture to capture schools, courses, offerings, teachers and teacher/student evaluations.
    • Planned the future phases and provided a road map for cloud deployments.
    Technologies: MySQL, MongoDB, Django, Python

  • Data Integration Architect

    2017 - 2019
    Exelon
    • Delivered integrations across several systems with the enterprise asset suite management system.
    • Led a 15-member team of offshore and onsite developers in the delivery of all integrations, data migrations, and decommissioning of old systems.
    • Migrated customers, products, and associated objects for over five million clients and 200,000 products using Informatica and Oracle Fusion middleware technologies.
    • Used GitHub as a source repository and Maven and Jenkins for continuous deployment.
    • Designed the data architecture for data migration and data cleansing of the home grown asset management systems.
    • Designed data pipelines to move data from asset management system into data lake.
    Technologies: Apache Kafka, Hadoop, Python, Oracle Database, Informatica ETL, Oracle Fusion Middleware

  • Enterprise Architect

    2015 - 2017
    Biogen
    • Managed product and vendor selection, technical architecture, data conversion and migration, proof-of-concept, and design standards.
    • Managed the LMS related data migration from SumTotal to SAP Success Factors. Delivered all integrations between the LMS and other systems.
    • Managed the reporting framework to produce dashboards and customized reports by integrating data from several of Biogen's core systems. The architect for reporting solutions using Informatica, Spark, and Tableau.
    • Loaded 23AndMe data into an inhouse MongoDB database and built data pipelines to map clinical results.
    Technologies: Oracle Fusion Middleware, Tableau, MongoDB, R, Python

  • Architect

    2014 - 2015
    GE, Celgene, DirecTV
    • Acted as the release captain responsible for the implementation of a heavily customized web-based Java application built on Oracle HR.
    • Acted as the enterprise architect responsible for defining the roadmap for the integration of LifeShield operations with DirecTV using Oracle Fusion Middleware technologies.
    • Defined the roadmap, implemented MDM, and consolidated integrations. Planned the roadmap for customer MDM at Celgene.
    Technologies: Oracle Fusion Middleware, Master Data Management (MDM)

  • Architect

    2011 - 2014
    SelectComfort, CanonEurope, Panduit
    • Acted as the solution architect responsible for delivering an integrated web experience to distributors and partners using Webcenter Suite, UCM, Oracle EBusiness modules (OM, AR), Heiler, and other client applications.
    • Spearheaded the project as the enterprise architect to bridge the business needs with the technology necessary to meet the business goals for eCommerce, master data management, document management, and product pricing.
    • Integrated the new eCommerce platform Hybris with existing back-end systems like Siebel, Oracle EBS, and SQL Server.
    • Responsible for the design, development of data marts, data warehouse, and OBIEE reports at Canon Europe, as a BI architect.
    Technologies: Oracle Fusion Middleware, eCommerce, ATG, SAP Hybris

  • Technical Manager

    2007 - 2010
    Accenture
    • Contributed to the “SOA Go-to-Market” strategy team and worked closely with client partners, senior executives, and Oracle Sales to close-out deals.
    • Executed several projects to Accenture clients using Oracle technologies.
    • Developed the canonical model based on OAGIS standards by closely working with business architects and leads.
    Technologies: Oracle Data Integrator (ODI), Service-oriented Architecture (SOA), Oracle Fusion Middleware, XQuery, Python

  • Technical Manager

    1997 - 2007
    Oracle
    • Led the BI portal group by managing a team of ten consultants while being billable 100%. The team’s utilization was more than 90%. Actively involved in recruiting, training, resourcing, mentoring, and growing the team. Organized portal night classes and training and invited several key senior members to give talks.
    • Implemented customer relationship modules (CRM) modules like iStore, iPayment, sales online, service contracts, XML gateway, and install base for clients like Canon, BMG, GE, and UBS.
    • Managed onsite and offshore resources of up to 50 consultants on projects.
    Technologies: Oracle Fusion Middleware, Oracle EBS, Java, Business Portals

Experience

  • Web Application to Capture Students' Performance

    Architected a web-based application for World Health Partners (India chapter) to be used by rural schools to enter students’ performance on quizzes. I designed the database objects and APIs from scratch to be used in the web application built with Python and Django and deployed in AWS. I also developed core APIs using Python, MySQL, and MongoDB databases.

  • Asset Data Migration

    The client had over six million customers in their CRM system and half a million assets in the GIS system. I was responsible for migrating these customers and assets one time into the new Asset Management System and plan for the syncing of updates between the two systems.

    *Oversaw and ensured delivery of all aspects of data analysis, mapping, and transfer.
    *Worked with program managers and business users to capture and analyze business requirements.
    *Conducted Gap analysis and developed data migration and integration plans.

  • Error Reporting of Failed Integrations

    The client had several integrations - real-time, batch, and near real-time. Integrations fail either due to hardware issues or software glitches. Many times it is hard for the source system to resend the data for failures. I built a semi-automated error handling framework to reprocess failed transactions wherever possible—built reports with a drill-down feature to get to the bottom of the erroneous transaction for root-cause analysis. I developed a web application using Python, XML, and PL/SQL.

Skills

  • Languages

    SQL, Python, Python 3, JavaScript, XQuery, R, Java, Snowflake

  • Tools

    Oracle JDeveloper 12c, Oracle ERP, Tableau, JDeveloper, SAP Hybris, Informatica ETL, DataGrip, Atom, Splunk, Apache Airflow

  • Platforms

    Linux, Oracle, Unix, Windows, Oracle Database, Apache Kafka, Oracle Data Integrator (ODI), Kubernetes, Amazon Web Services (AWS)

  • Storage

    PostgreSQL, MySQL, Neo4j, NoSQL, MongoDB, Master Data Management (MDM), Redshift, Oracle SQL Developer

  • Other

    Data Architecture, Oracle Fusion Middleware, Data Modeling, ATG, eCommerce, Business Portals, Oracle EBS, Lab Information Management Software (LIMS), Data Engineering

  • Frameworks

    Express.js, Hadoop, Django, Ruby on Rails (RoR)

  • Libraries/APIs

    React, Node.js, jQuery

  • Paradigms

    Service-oriented Architecture (SOA)

Education

  • ICWA (Master’s Degree Equivalent) in Cost Accounting
    1987 - 1989
    Institute of Cost and Works Accountants of India - Kolkata, India
  • Master of Science Degree in Applied Math
    1982 - 1984
    Anna University - Chennai, India
  • Bachelor of Science Degree in Mathematics
    1978 - 1982
    Madras University - Chennai, India

Certifications

  • Google Cloud Platform Fundamentals: Core Infrastructure
    MAY 2020 - PRESENT
    Coursera
  • Google Cloud Platform Big Data and Machine Learning Fundamentals
    MAY 2020 - PRESENT
    Coursera
  • Oracle Database Administrator
    OCTOBER 2005 - PRESENT
    Oracle Corporation

To view more profiles

Join Toptal
Share it with others
Hire the top 3% of freelance developers TM