Scroll To View More
Mikhail Lyukmanov, Full-stack Developer in Los Angeles, CA, United States
Mikhail Lyukmanov

Full-stack Developer in Los Angeles, CA, United States

Member since October 29, 2017
Mikhail is an adtech, data, and analytics professional with over 15 years of experience building and maintaining data lakes, data warehouses, DMPs, and ETL pipelines. He implements a simple minimalist approach in solving complex business and technical challenges. He is also a big fan of open-source software.
Mikhail is now available for hire

Portfolio

Experience

  • SQL, 15 years
  • Bash, 10 years
  • Hadoop, 10 years
  • PostgreSQL, 7 years
  • MySQL, 7 years
  • Python, 6 years
  • HBase, 5 years
  • Scala, 2 years
Los Angeles, CA, United States

Availability

Part-time

Preferred Environment

PostgreSQL, Spark, Hadoop, Python, Oracle, MS SQL

The most amazing...

...thing I've done was to architect and build a scalable DMP (data management platform) which hosted over 600 million ad profiles for worldwide customers.

Employment

  • Vice President of Software Engineering, Data

    2014 - PRESENT
    Amobee
    • Worked as head of the Amobee global data engineering team.
    • Built world-class scalable data solutions for internal and third-party clients. For example, a scalable distributed DMP (data management platform) was built on an open-source stack that supported near real-time data processing. The solution was tested for up to 10 billion user profiles and terabytes of data streaming through the platform.
    • Developed and maintained an existing data warehouse (PostgreSQL) and ETL pipelines (Hadoop, Spark, Scala, and MapReduce).
    • Built and supported BI solutions (Microstrategy, Tableau, Metabase, Re:dash).
    • Integrated AWS Cloud and developed apps (S3, Lambda, Redshift, and Kinesis).
    Technologies: CDH Hadoop, Cassandra, HBase, Spark, PostgreSQL, Docker, AWS, Python, Scala, Kubernetes, Git
  • Engineer

    2005 - PRESENT
    Freelance Software Development
    • Developed web applications for various customers.
    • Built an education planner for Transamerica Retirement Division, Ta-retirement.com/sip/shared/educationplanner/planner.aspx; used C#, responsive web design, jQuery, CSS, JSON, and iTextSharp.
    • Developed a marketing planner for Transamerica; used C#, responsive web design, jQuery, CSS, and iTextSharp.
    Technologies: PostgreSQL, MySQL, C#, jQuery, AJAX, Apache HTTP, Apache Tomcat, Git
  • Vice President of Data Engineering

    2013 - 2014
    Adconion Media Group
    • Facilitated the successful implementation of the entire new internal business intelligence/data warehouse platform; it has more than 300+ worldwide users and is used in more than 15 countries.
    Technologies: Hadoop, HBase, PostgreSQL, MS SQL, Python, Hive, Pig, Git
  • Senior Manager Data Warehouse and Business Intelligence

    2010 - 2013
    Adconion Media Group
    • Created specs and helped with the hardware provisioning for a new database (PostgreSQL) and Microstrategy servers.
    • Architected data marts and a BI domain model.
    • Designed and provided lifecycle support of the existing enterprise data warehouse (PostgreSQL) and a number of reporting platforms (Jasper BI, Microstrategy, and Tableau).
    • Handled the release management of the code—implementing best practices and coding standards.
    Technologies: PostgreSQL, MySQL, SQL, PL/SQL, Python, Bash, Crontab
  • Manager, Data Services

    2006 - 2010
    Edmunds.com
    • Spearheaded the implementation and installment of a Hadoop cluster in Edmunds enterprise.
    • Utilized Hadoop cluster and its MapReduce functionality which led to the doubling the performance of our daily data warehouse weblog loads.
    Technologies: Oracle, SQL, PL/SQL, Informatica, Hadoop, MapReduce, Pig, Hive
  • Senior Data Architect

    2006 - 2008
    Edmunds.com
    • Established from the ground up the development of a universal vehicle database with workflow management, a centralized dealer database, and a centralized geographic database.
    • Evangelized and implemented a database release paradigm. It allowed us to keep track of all the changes as well as streamlined the release process.
    Technologies: Oracle, Informatica, Netezza, Hadoop, PL/SQL, ETL, Oracle APEX, Linux Shell Scripting
  • Senior Software Developer

    2003 - 2005
    Cymetrix
    • Developed and administered the corporate database.
    • Wrote up the financial reporting.
    • Developed intranet applications (timesheets application, project management application).
    • Implemented data mining.
    Technologies: MS SQL 2000, 2005, C#.NET, ASP.NET, IIS, Datawatch Monarch, VorteXML, ActiveReports, SQL Server Reporting Services
  • Tech Lead Software Engineering

    2001 - 2003
    Arthur Andersen, LLP
    • Designed and implemented Atlas (Assignment Tax calcuLAtion System): a multi-user web-based application based on MS SQL 2000 (later moved to Oracle 8i), IIS/ASP and with Microsoft Office XP web components. It was developed for Arthur Andersen and supports tax calculations for more than 84 countries.
    Technologies: MS SQL 2000, Oracle 8i, ASP, JavaScript, VBScript, PL/SQL, DTS, BCP, XML

Experience

  • Content.ad Snowflake Data Pipelines (Development)

    Using Snowflake and AWS DMS, I built and enabled real-time data pipelines connecting Kafka, AWS S3, AWS RDS, AWS DynamoDB, and Snowflake data warehouse.
    It resulted in near-real-time CDC(change data capture) replication using snow pipes, streams, tasks, and other latest Snowflake technology.

    Technologies: AWS, Python, Bash, Bitbucket, Snowflake

  • Amobee DMP (Development)

    A global distributed scalable application which included:
    • a data lake
    • a data warehouse
    • API integrations with multiple third-party customers
    • an analytical suite

    Technologies: CDH (Cloudera Distributed Hadoop), Spark, Scala, Python, HBase, Oozie, Git, PostgreSQL, Cassandra, AWS EMR, AWS Lambda, AWS Redshift, AWS Gateway, AWS Kinesis, AWS S3, Glacier, Tableau, and Metabase

  • Amobee Email Data Warehouse (Development)

    I developed a data warehouse which was built on AWS stack and it was designed to:
    • Manage user profiles
    • Manage email events (opens, clicks, unsubscribes)
    • Run custom reporting requests
    • Ensure data security, protection, and monitored access

    Technologies: AWS Redshift, AWS EMR, AWS S3, AWS Lambda

  • Adconion Data Warehouse (Development)

    I developed a data warehouse built on the PostgreSQL platform. It was designed to store and manage ad campaigns, ad performance, financials, and other KPIs.

    Technologies: Python, PostgreSQL, CHD (Cloudera Distributed Hadoop)

  • Adconion BI Suite (Development)

    An analytics suite, built on the Microstrategy platform that was deployed to a worldwide audience—where over 300 users in 15 countries were using the application.

    Technologies: Microstrategy, Java, PostgreSQL

  • Transamerica Educational Planner (Development)

    An application for the Transamerica retirement division. It was designed to help plan the retirement education sessions for Transamerica professionals.

Skills

  • Languages

    SQL, Bash Script, Bash, JavaScript, Python, PHP, Scala, C#, T-SQL
  • Paradigms

    Agile Product Management, DevOps, REST
  • Storage

    AWS S3, HDFS, PostgreSQL, Redshift, MySQL, Cassandra, AWS RDS, Oracle PL/SQL, HBase, Microsoft SQL Server
  • Other

    Web Development, Bash Scripting, AWS API Gateway
  • Frameworks

    Hadoop, AWS EMR
  • Tools

    pgAdmin, Git, Oozie
  • Libraries/APIs

    jQuery
  • Platforms

    Linux, AWS Kinesis

Education

  • Master of Science degree in Algorithms, Math, and Physics
    1991 - 1996
    Nizhny Novgorod State Technical University - Nizhny Novgorod, Russia
I really like this profile
Share it with others