Senior Big Data Engineer

We are seeking an experienced Senior Big Data Engineer to join a leading beauty industry innovator.

The ideal candidate will be deeply involved in aggregating commercial purchases, marketing campaigns, catalog data, and more from various sources into a data lake, helping to redefine the way beauty is perceived and offered.

Responsibilities

• Architect and maintain ETL and ELT pipelines, large batch/micro batch processing, and streaming systems
• Build the infrastructure for optimal data extraction, transformation, and loading using ADF, Spark, or Kafka
• Identify and implement internal process improvements such as automating manual operations and optimizing data delivery
• Act as a single point of contact for top management and stakeholders over any delivery-related matters
• Provide technical leadership and ensure sound architecture and technical quality standards in implementations
• Write user stories and acceptance criteria for agile/scrum workflows
• Coordinate with multiple disciplines and stakeholders to align on project requirements
• Ensure projects align with client processes and methodologies, focusing on agile approaches
• Develop a strategy for continuous delivery and risk management throughout the delivery cycle
• Measure and work to improve delivery productivity
• Support Data Engineers by providing consultation to ensure quality and timely delivery
• Perform production support and execute deployment activities
  
  
  

Requirements

• Proficiency in SQL, Spark, and Scala
• Competency in building infrastructure for data extraction, transformation, and loading
• Understanding of internal process improvements such as automation and data optimization
• Background in technical leadership, including ensuring architectures meet quality standards
• Capability to write and manage agile/scrum workflow user stories
• Familiarity with coordinating project requirements among various stakeholders
• Knowledge of various delivery models with a focus on agile methodologies
• Expertise in strategy development for continuous delivery and risk management
• Proficiency in measuring and improving delivery productivity
• Experience with production support and deployment activities
• Strong interpersonal and communication skills
• English proficiency at level B2 or above
  
  
  

Nice to have

• Familiarity with Spark Streaming, Azure, and Databricks
  
  
  

We offer

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Consider relocation options in over 30 countries worldwide
• Participate in volunteer, charity programs and communities (both technical and interest-based)
• You can plan your individual career path together with your manager.
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children
  
  
  

EPAM strives to provide its global team of over 52,800+ professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.