Scroll To View More
Mikhail Lyukmanov

Mikhail Lyukmanov

Los Angeles, CA, United States
Member since October 29, 2017
Mikhail is an adtech, data, and analytics professional with over 15 years of experience building and maintaining data lakes, data warehouses, DMPs, and ETL pipelines. He implements a simple minimalist approach in solving complex business and technical challenges. He is also a big fan of open-source software.
Mikhail is now available for hire
Portfolio
Experience
  • SQL, 15 years
  • Hadoop, 10 years
  • Bash, 10 years
  • PostgreSQL, 7 years
  • MySQL, 7 years
  • Python, 6 years
  • HBase, 5 years
  • Scala, 2 years
Los Angeles, CA, United States
Availability
Part-time
Preferred Environment
PostgreSQL, Spark, Hadoop, Python, Oracle, MS SQL
The most amazing...
...thing I've done was to architect and build a scalable DMP (data management platform) which hosted over 600 million ad profiles for worldwide customers.
Employment
  • Vice President of Software Engineering, Data
    2014 - PRESENT
    Amobee
    • Worked as head of the Amobee global data engineering team.
    • Built world-class scalable data solutions for internal and third-party clients. For example, a scalable distributed DMP (data management platform) was built on an open-source stack that supported near real-time data processing. The solution was tested for up to 10 billion user profiles and terabytes of data streaming through the platform.
    • Developed and maintained an existing data warehouse (PostgreSQL) and ETL pipelines (Hadoop, Spark, Scala, and MapReduce).
    • Built and supported BI solutions (Microstrategy, Tableau, Metabase, Re:dash).
    • Integrated AWS Cloud and developed apps (S3, Lambda, Redshift, and Kinesis).
    Technologies: CDH Hadoop, Cassandra, HBase, Spark, PostgreSQL, Docker, AWS, Python, Scala, Kubernetes, Git
  • Engineer
    2005 - PRESENT
    Freelance Software Development
    • Developed web applications for various customers.
    • Built an education planner for Transamerica Retirement Division, Ta-retirement.com/sip/shared/educationplanner/planner.aspx; used C#, responsive web design, jQuery, CSS, JSON, and iTextSharp.
    • Developed a marketing planner for Transamerica; used C#, responsive web design, jQuery, CSS, and iTextSharp.
    Technologies: PostgreSQL, MySQL, C#, jQuery, AJAX, Apache HTTP, Apache Tomcat, Git
  • Vice President of Data Engineering
    2013 - 2014
    Adconion Media Group
    • Facilitated the successful implementation of the entire new internal business intelligence/data warehouse platform; it has more than 300+ worldwide users and is used in more than 15 countries.
    Technologies: Hadoop, HBase, PostgreSQL, MS SQL, Python, Hive, Pig, Git
  • Senior Manager Data Warehouse and Business Intelligence
    2010 - 2013
    Adconion Media Group
    • Created specs and helped with the hardware provisioning for a new database (PostgreSQL) and Microstrategy servers.
    • Architected data marts and a BI domain model.
    • Designed and provided lifecycle support of the existing enterprise data warehouse (PostgreSQL) and a number of reporting platforms (Jasper BI, Microstrategy, and Tableau).
    • Handled the release management of the code—implementing best practices and coding standards.
    Technologies: PostgreSQL, MySQL, SQL, PL/SQL, Python, Bash, Crontab
  • Manager, Data Services
    2006 - 2010
    Edmunds.com
    • Spearheaded the implementation and installment of a Hadoop cluster in Edmunds enterprise.
    • Utilized Hadoop cluster and its MapReduce functionality which led to the doubling the performance of our daily data warehouse weblog loads.
    Technologies: Oracle, SQL, PL/SQL, Informatica, Hadoop, MapReduce, Pig, Hive
  • Senior Data Architect
    2006 - 2008
    Edmunds.com
    • Established from the ground up the development of a universal vehicle database with workflow management, a centralized dealer database, and a centralized geographic database.
    • Evangelized and implemented a database release paradigm. It allowed us to keep track of all the changes as well as streamlined the release process.
    Technologies: Oracle, Informatica, Netezza, Hadoop, PL/SQL, ETL, Oracle APEX, Linux Shell Scripting
  • Senior Software Developer
    2003 - 2005
    Cymetrix
    • Developed and administered the corporate database.
    • Wrote up the financial reporting.
    • Developed intranet applications (timesheets application, project management application).
    • Implemented data mining.
    Technologies: MS SQL 2000, 2005, C#.NET, ASP.NET, IIS, Datawatch Monarch, VorteXML, ActiveReports, SQL Server Reporting Services
  • Tech Lead Software Engineering
    2001 - 2003
    Arthur Andersen, LLP
    • Designed and implemented Atlas (Assignment Tax calcuLAtion System): a multi-user web-based application based on MS SQL 2000 (later moved to Oracle 8i), IIS/ASP and with Microsoft Office XP web components. It was developed for Arthur Andersen and supports tax calculations for more than 84 countries.
    Technologies: MS SQL 2000, Oracle 8i, ASP, JavaScript, VBScript, PL/SQL, DTS, BCP, XML
Experience
  • Amobee DMP (Development)

    A global distributed scalable application which included:
    • a data lake
    • a data warehouse
    • API integrations with multiple third-party customers
    • an analytical suite

    Technology Stack: CDH (Cloudera Distributed Hadoop), Spark, Scala, Python, HBase, Oozie, Git, PostgreSQL, Cassandra, AWS EMR, AWS Lambda, AWS Redshift, AWS Gateway, AWS Kinesis, AWS S3, Glacier, Tableau, and Matabase

  • Amobee Email Data Warehouse (Development)

    I developed a data warehouse which was built on AWS stack and it was designed to:
    • Manage user profiles
    • Manage email events (opens, clicks, unsubscribes)
    • Run custom reporting requests
    • Ensure data security, protection and monitored access

    Technology Stack: AWS Redshift, AWS EMR, AWS S3, AWS Lambda

  • Adconion Data Warehouse (Development)

    I developed a data warehouse built on the PostgreSQL platform. It was designed to store and manage ad campaigns, ad performance, financials, and other KPIs.

    Technology Stack: Python, PostgreSQL, CHD (Cloudera Distributed Hadoop)

  • Adconion BI Suite (Development)

    An analytics suite, built on the Microstrategy platform that was deployed to a worldwide audience—where over 300 users in 15 countries were using the application.

    Technology Stack: Microstrategy, Java, PostgreSQL

  • Transamerica Educational Planner (Development)

    An application for the Transamerica retirement division. It was designed to help plan the retirement education sessions for Transamerica professionals.

Skills
  • Languages
    SQL, Bash Script, Bash, JavaScript, PHP, Scala, C#, T-SQL, Python
  • Paradigms
    Agile Product Management, DevOps, REST
  • Storage
    PostgreSQL, HDFS, AWS S3, Oracle PL/SQL, MySQL, HBase, Cassandra, AWS RDS, RedShift, Microsoft SQL Server
  • Frameworks
    Hadoop, AWS EMR
  • Tools
    pgAdmin, Git, Oozie
  • Other
    Bash Scripting, AWS API Gateway
  • Libraries/APIs
    jQuery
  • Platforms
    Linux, AWS Kinesis
Education
  • Master of Science degree in Algorithms, Math, and Physics
    1991 - 1996
    Nizhny Novgorod State Technical University - Nizhny Novgorod, Russia
I really like this profile
Share it with others