Senior Database Engineer (Iceberg) IRC301498
GlobalLogic
Description
We are seeking an expert Database Engineer to design, optimize, and scale our next-generation multi-cloud data lakehouse architecture across AWS and Azure. In this role, you will leverage Client’s Open Lakehouse (integrated with Client’s Talend Cloud) to establish a low-overhead, high-throughput data foundation. You will manage automated data ingestion, implement continuous table optimization, handle cross-cloud data mirroring, and ensure seamless multi-engine access without vendor lock-in.
Requirements
Experience: 5+ years in Data Engineering/Architecture, with at least 2 years focused heavily on Apache Iceberg implementations.
Scale: Proven track record of managing multi-petabyte datasets and high-throughput streaming/batch ingestion pipelines.
Problem Solving: Experience troubleshooting write conflicts, file sizing issues (small file problem), and catalog synchronization bottlenecks.
Job responsibilities
Architecture Design: Build and maintain scalable ACID-compliant data lakehouses using Apache Iceberg
Schema & Partition Evolution: Manage seamless updates to schemas and partition specs without rewriting historical data.
Engine Integration: Configure and optimize Iceberg catalogs
Data Governance: Implement row-and-column level security, time-travel queries, and data retention/vacuuming protocols.
Best Practices: Establish development standards for concurrent writes, branching, tagging, and conflict resolution.
What we offer
Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people’s lives.
Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.
DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.
Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.
Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.
Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.
About GlobalLogic
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.
We are seeking an expert Database Engineer to design, optimize, and scale our next-generation multi-cloud data lakehouse architecture across AWS and Azure. In this role, you will leverage Client’s Open Lakehouse (integrated with Client’s Talend Cloud) to establish a low-overhead, high-throughput data foundation. You will manage automated data ingestion, implement continuous table optimization, handle cross-cloud data mirroring, and ensure seamless multi-engine access without vendor lock-in.
Requirements
Experience: 5+ years in Data Engineering/Architecture, with at least 2 years focused heavily on Apache Iceberg implementations.
Scale: Proven track record of managing multi-petabyte datasets and high-throughput streaming/batch ingestion pipelines.
Problem Solving: Experience troubleshooting write conflicts, file sizing issues (small file problem), and catalog synchronization bottlenecks.
Job responsibilities
Architecture Design: Build and maintain scalable ACID-compliant data lakehouses using Apache Iceberg
Schema & Partition Evolution: Manage seamless updates to schemas and partition specs without rewriting historical data.
Engine Integration: Configure and optimize Iceberg catalogs
Data Governance: Implement row-and-column level security, time-travel queries, and data retention/vacuuming protocols.
Best Practices: Establish development standards for concurrent writes, branching, tagging, and conflict resolution.
What we offer
Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people’s lives.
Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.
DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.
Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.
Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.
Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.
About GlobalLogic
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.
Як відгукнутися?
Щоб відгукнутися на цю вакансію, вам необхідно авторизуватися на нашому сайті. Якщо у вас ще немає облікового запису, будь ласка, зареєструйтесь.
Розмістити резюмеСхожі вакансії
CG Artist
Wargaming,
Київ,
3 години тому
Bring your passion for creating precise hard-surface models and realistic vehicles into the world of AAA games. Wargaming Kyiv is looking for a skilled 3D Artist to help bring iconic armored vehicles to life in some of our most well-known titles. If you have a sharp eye for detail, strong modeling expertise, and a solid understanding of vehicle design, we’d...
Senior Java Developer – Tieto Tech Consulting (m/f/d)
Tieto,
Київ,
2 дні тому
Job Description Tieto Tech Consulting, is looking for a highly skilled and motivated Senior Java Developer , a professional who will join a project within a Telecom Team for our respectful client BICS. Join the team of our customer BICS – a global telecommunication enabler with a physical network stretching through the globe! Grow your expertise through interacting with A-level...
Azure Security Engineer (Remediation & DevSecOps)
EPAM Systems,
Київ,
2 дні тому
We are seeking a hands-on Azure Security Engineer to focus on fixing security gaps across the Azure cloud environment. In this technical role, you will specialize in vulnerability remediation, AKS hardening, and network isolation using private connectivity and automated pipelines to strengthen our overall cloud security posture. Kindly note that this role supports remote work, but only from within...
