Lead Big Data Engineer

Our client is an international manufacturer of cosmetics, perfumes, skin and hair care products. The goal of the project is to create a solution for integrating unstructured data for our client's Data Lake using their own Azure cloud services.

Responsibilities

• Coordinate and supervise the work of the data processing software development team
• Set up and maintain the development process and tools to ensure efficient execution according to industry best practices (EngX)
• Lead and facilitate the implementation of MVP for unstructured data entering the system
• Participate in backlog support and Scrum processes
• Participate in the creation of BRD, SAD and further implementation of backlog and instructions for the next stages of the project
  
  
  

Requirements

• Experience with Data Platform & Solution engineering and Azure's PaaS offerings
• Competence in Azure: Data Factory, Data Lake, Databricks, Microsoft Purview, Monitor, Storage Services, ADLS, Azure Functions, Log Analytics, Serverless Architecture, Azure Cognitive Services, Azure Form Recognizer
• Practical experience and high level of proficiency in Python and GraphQL
• Knowledge of security best practices (e.g. using Azure Key Vault, IAM, RBAC, Monitor, etc.)
• Ability to integrate, transform and consolidate data from various structured and unstructured data systems into a structure suitable for building various analytical solutions
• Good communication skills, ability to work in a team
• High level of understanding of Azure DevOps, experience working in an Agile environment (Scrum, Kanban)
• Work experience with Azure ML will be an advantage
• Knowledge of written and spoken English at the level of Upper-Intermediate and above (B2+)
  
  
  

We offer

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Consider relocation options in over 30 countries worldwide
• Participate in volunteer, charity programs and communities (both technical and interest-based)
• You can plan your individual career path together with your manager.
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children
  
  
  

EPAM strives to provide its global team of over 52,800+ professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.