Senior Data Engineer, DataBricks Platform, Canada and US

About the jobCloudGeometry is a Silicon Valley-based cloud-native system integrator with deep expertise in AWS and the CNCF technology stack. We partner with industry leaders like AWS, Google and Databricks to deliver solutions across all layers of the modern technology stack, from generative UI to Kubernetes-powered MLOps workloads. Our distributed team of top technology experts from the US, Europe, and LATAM collaborates on innovative commercial and open-source projects. Our commitment to innovation and excellence makes us a trusted partner for leading technology companies and VC-funded startups. We are looking for a Senior Data Engineer with extensive hands-on experience in the Databricks ecosystem and exceptional communication skills to join our flagship project: a cutting-edge Data Platform for the life sciences industry. This platform supports industry leaders such as Pfizer, Moderna, and Novartis in developing innovative RNA-based solutions, leveraging data-driven research, cloud computing, and advanced AI capabilities. This role offers a unique opportunity for an experienced data engineer to take the next step in their career, playing a key technical leadership role in the rapidly evolving world of AI-driven solutionsResponsibility Design, develop, and optimize data pipelines and workflows within the Databricks platform.Take part in architecture discussion with engineering, product managers and data scientists to implement advanced analytics solutions that drive business insights.Build, optimize, and fine-tune Databricks workflows to improve performance and reliability.Work closely with data scientists and analysts to iEnsure the integrity, accuracy, and security of data across all processing stages.Implement data ingestion from various sources into Databricks, ensuring data quality and reliability.Participate in daily Scrum ceremonies and collaborate with team members in the US and Europe with required online presence from 9 AM to 5 PM ESTQualifications Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.8+ years of experience in the software development industry, preferably in data engineering, data warehousing or data analytics companies and teams. 1+ year of experience with the DataBricks ecosystem. Expert level of Python and Typescript. Expert level of understanding and hands-on experience with Lake House architecture. Expert level of experience with Spark/Glue and Delta tables/iseberg.Experienced in designing and implementing complex, scalable data pipelines/ETL processes using Databricks.Skilled in cloud-based data storage and processing technologies, particularly AWS services such as S3, Step Functions, Lambda, and Airflow.Familiar with CI/CD practices, version control (Git), automated testing, and Agile environments.Experience with the Agile development process in a distributed engineering team.Ability to articulate ideas clearly, present findings persuasively, and build rapport with clients and team members.Experience working in US-led high-tech companies and startups.Nice to HaveDataBricks certifications AWS or Azure DevOps or SA certifications Knowledge of basic DevOps and MLOps principles Experience in working with Data Scientists and ML Developers Experience in management and lead developer roles from technology services companiesWhat we commit to youComprehensive compensation and benefits package.Opportunity to work with cutting-edge technologies; no legacy systems.Extensive training opportunities including certifications, hackathons, remote conference attendance, and free access to Udemy and other digital learning platforms.Collaborative and supportive environment with top global experts to help you reach new professional heights and advance in your career.