Valentin Shilin
Verified Expert in Engineering
Palantir Architect and Developer
Cologne, North Rhine-Westphalia, Germany
Toptal member since April 14, 2026
Valentin is a Palantir architect at Deutsche Telekom Services specializing in data architecture, big data, and AI-driven solutions. He delivers scalable data platforms, builds high-performance data pipelines, and develops AI-powered systems that enable data-driven decision-making. With strong expertise in Apache Spark and Python, Valentin also teaches at OTUS, helping engineers build production-ready skills. Based in Germany, he combines hands-on experience with mentoring.
Portfolio
Experience
- SQL - 15 years
- Python - 12 years
- Apache Spark - 10 years
- Big Data - 10 years
- PySpark - 10 years
- Apache HBase - 5 years
- Palantir Foundry - 3 years
- Palantir - 3 years
Preferred Environment
Python, Palantir Foundry, SQL, Palantir AIP, Palantir Foundry Pipeline Builder, Palantir, Palantir AIP Logic, Scala, Spark, Docker
The most amazing...
...work I've done is build PySpark pipelines, gathering data and computing embeddings—delivering elegant, scalable solutions with strong real-world impact.
Work Experience
Senior Palantir Developer & Architect
Deutsche Telekom
- Designed and implemented scalable data platforms and pipelines using Spark and Python, enabling efficient processing of large-scale enterprise data.
- Developed AI-driven chatbot solutions with structured data pipelines, improving automation and data accessibility for business users.
- Architected big data solutions with strong access control models, ensuring secure and compliant data usage across teams.
Senior Scala Developer, Big Data & Hadoop Cloudera CDH
Deutsche Telekom
- Designed and implemented the N2N diagnostics platform for DSL and fiber networks across Germany, enabling scalable monitoring and issue detection.
- Architected and developed big data pipelines using Spark and Scala to process large-scale telecom data efficiently.
- Collaborated with business stakeholders to translate requirements into scalable technical solutions and system architecture.
- Improved data processing performance and reliability through optimized Spark jobs and distributed system design.
- Led end-to-end development lifecycle, including architecture, implementation, testing, deployment, and production support.
Senior Back-end Developer, Big Data
Cognotekt
- Developed data processing tools for AI-driven systems, enabling efficient handling of large-scale datasets.
- Built and optimized data pipelines using Python and Spark for scalable and reliable data processing.
- Designed back-end services and integrated them with PostgreSQL for high-performance data storage and retrieval.
- Containerized applications using Docker and improved deployment workflows with GitLab CI.
- Enhanced system reliability and maintainability through clean architecture and automation practices.
Software Engineer
Eurofins
- Developed and enhanced a WPF-based application (CL-AP) for configuring and executing validation processes for laboratory samples, integrating with ELIMS modules and databases, improving data accuracy, and streamlining workflows across labs globally.
- Designed and implemented scalable and high-performance system components using C#, .NET 4.5, and Entity Framework, including a multithreaded calculation subsystem that reduced sample processing time and increased system throughput.
- Worked with a Scrum team to deliver new features and improvements, conducted code reviews, provided end-user support, and worked closely with business and functional analysts to translate requirements into reliable, high-quality technical solutions.
Experience
ChatBot Back end
https://www.telekom.de/hilfe/frag-magentaDSL Network Analytics Platform for Germany
Built with Scala and Apache Spark on a Hadoop CDP cluster, the platform handles high-volume batch and near-real-time data processing. I implemented distributed data pipelines, optimized Spark jobs for performance, and designed scalable data models for efficient querying and analysis.
The solution enables telecom operators to identify degradation patterns, detect faults before they impact customers, and significantly reduce incident response time. I also collaborated with cross-functional teams to integrate data sources and deliver actionable insights for network operations.
Education
Master's Degree in Computer Science
Saint Petersburg State University - Saint-Petersburg, Russia
Skills
Libraries/APIs
PySpark
Tools
Palantir AIP Logic, Oozie, Apache Impala, Apache HBase, Pytest, BigQuery
Languages
Python, Scala, SQL, Go, JavaScript, Java
Frameworks
Spark, Apache Spark, Hadoop, Django, Ontology Framework, Oracle ADF, .NET
Paradigms
Business Intelligence (BI), Automation, ETL
Platforms
Palantir Foundry, Palantir Foundry Pipeline Builder, Docker, Apache Kafka, Oracle, Google Cloud Platform (GCP)
Storage
Data Pipelines, Apache Hive, Databases, Amazon S3 (AWS S3), Microsoft SQL Server
Other
Palantir AIP, Palantir, Data Architecture, Big Data, Data Engineering, AI Chatbots, Access Control, Data Processing, Distributed Systems, Dashboards, Data Analysis, Quality Assurance (QA), APIs, Agentic RAG Systems, Back-end, FastAPI, RAG Architecture, RAG Systems, Scalability, Large Language Models (LLMs), Artificial Intelligence (AI), Data Build Tool (dbt), Data Warehousing, Data Governance, Data Quality, Data Analytics, AI Model Training, AI Automation, Streaming, Machine Learning
How to Work with Toptal
Toptal matches you directly with global industry experts from our network in hours—not weeks or months.
Share your needs
Choose your talent
Start your risk-free talent trial
Top talent is in high demand.
Start hiring