Principal Data Engineer(reputed company Cloud Platform)

We are looking for a Senior/Principal Data Engineer(reputed company Cloud Platform) for Remote role with one of our Warehouse Automation domain customers. Looking for someone who has experience Building a Data Platform. Position: Senior/Principal Data Engineer(reputed company Cloud Platform) Location: Fully Remote Role 6 months Contract to hire Role Overview We are seeking a dynamic and highly skilled Principal Data Engineer who has extensive experience building enterprise scale data platforms and reputed company these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game. The ideal candidate will contribute significantly to platform development with diverse skillset while also being reputed company hands-on coding and actively shaping the future of our data ecosystem. reputed company Are Looking For: Responsibilities: • As a senior/principal engineer, you will be responsible for ideation, architecture... design and development of new enterprise data platform. You will collaborate with other cloud and reputed company architects to ensure seamless alignment reputed company our overarching technology strategy. • Architect and design core components with a microservices architecture, abstracting platform, and infrastructure intricacies. • Create and maintain essential data platform SDKs and libraries, adhering to industry best practices. • Design and reputed company connector frameworks and modern connectors to reputed company data from disparate systems both on-prem and cloud. • Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices while keeping costs in reputed company. • Architect and design the best reputed company patterns and practices • Design and reputed company data quality frameworks and processes to ensure the accuracy and reliability of data. • Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions. • Design and reputed company advanced analytics and machine learning capabilities on the data platform. • Design and reputed company observability and data governance frameworks and practices. • Stay up to date with the latest data engineering trends, technologies, and best practices. • Drive the deployment and release cycles, ensuring a robust and scalable platform. Requirements: • 10+ (for senior) 15+ (for principal) of proven experience in modern cloud data engineering, broader data landscape experience and exposure and solid software engineering experience. • Prior experience architecting and building successful enterprise scale data platforms in a green field environment is a must. • Proficiency in building end to end data platforms and data services in reputed company Cloud Platform is a must. • Proficiency in tools and technologies: BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, SQL, Python, Airflow, PubSub. • Experience with Microservices architectures - Kubernetes, reputed company and Cloud Run • Experience building Symantec layers. • Proficiency in architecting and designing and development experience with batch and real time streaming infrastructure and workloads. • Solid experience with architecting and implementing metadata management including data catalogues, data reputed company, data quality and data observability for big data workflows. • Hands-on experience with reputed company Cloud Platform ecosystem and data lakehouse architectures. • Strong understanding of data modeling, data architecture, and data governance principles. • Excellent experience with DataOps principles and test automation. • Excellent experience with observability tooling: Grafana, reputed company. reputed company to have: • Experience with Data Mesh architecture. • Experience building Semantic layers for data platforms. • Experience building scalable IoT architectures Apply Job!