Lead Engineer, Public & Alternative Investments, Data Platforms

Job Description As a Lead Engineer, you will be working on the Data Service Applications for Public Markets and Alternative Assets. The role will involve - Role-Specific Accountabilities: Leading the design, implementation and deployment of data pipelines to transform (structure and map) vendor data into CPPIB standard format. Design solutions aligned with long-term architecture and technology strategy using Amazon Web Services (AWS) for Cloud development. Participate in the development life cycle from start to completion - requirements analysis, development, testing, and deployment. Design and implement the data model and enriched strategy neutral data. Design and implement the data service using Amazon Web Service (AWS). Design and implement data related tools and analytics, in addition to operational processes. Address daily data exceptions on a timely basis and provide L3 operation support. Stay current with new data vendor product offerings and how they might be used by the quantitative investment groups. Manage and enhance investment data infrastructure through initiatives such as improving metadata and data integrity. Work in a fast-paced environment collaborating with business users, engineers, architects, researchers, and data scientists. Qualifications A Bachelor’s degree in computer science or engineering. Hands-on Experience with data engineering technologies such as AWS Glue, EMR, Athena, Redshift, Lake Formation, Apache Spark, Apache Hive, Apache Airflow, S3, CloudWatch, Lambda, Apache Hudi, API Gateway, GraphQL, Elastic Search, Elastic Cache and Trino. Hands-on experience with CI/CD pipeline using Terraform, Jenkins, Github actions, Gitflow. Experience working with RESTful APIs. Familiarity with microservices architecture. Strong programming skills in Python, pyspark, SQL, Java with professional programming experience in a data context (e.g. data extraction, data manipulation, joins, data analysis, data model design etc.). Experience of building data pipelines using orchestration tool like Apache Airflow. Experience in ML and Generative AI is a big plus. Ability to deliver time-sensitive deadlines. Good understanding of financial data; CFA is a plus. Passionate to learn new technology. Our Commitment to Inclusion and Diversity: In addition to being dedicated to building a workforce that reflects diverse talent, we are committed to fostering an inclusive and accessible experience. If you require an accommodation for any part of the recruitment process (including alternate formats of materials, accessible meeting rooms, etc.), please let us know and we will work with you to meet your needs. #J-18808-Ljbffr