Canadian Citizenship Required - Data Engineer - 100% REMOTE WORK

Job Title: Data Engineer JD1Required: US Citizenship or Canadian Citizenship100% RemoteCompany Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing defense intelligence professionals with high-fidelity data solutions that enable these customers to derive insights in minutes. The company is a fast-moving, and high-performance startup.We are a fast-growing early-stage company in the process of closing our seed funding led by a well-recognized venture firm. We value a diverse team and believe inclusion performs better. We believe that trust + autonomy = better results and more job satisfaction. Since we are building something new and helping unlock the power of massive-scale data to make the world safer, stronger, and more prosperous, a mission-driven mindset and entrepreneurial spirit are a must.Team Overview: We are a passionate team of technologists, data scientists, and analysts with backgrounds in operational intelligence, law enforcement, large multinationals, and cybersecurity operations. We obsess about designing products that will change the way global companies, governments and nonprofits protect themselves from external threats and global adversaries.Position Overview: We're looking for a skilled Data Engineer to specialize in designing, implementing, and optimizing data pipelines and storage solutions to manage our extensive datasets, ranging from hundreds of terabytes to petabytes. You will play a key role in ensuring data integrity, accessibility, and security while working closely with our infrastructure engineers to automate and streamline data processes.Team Principles:At Atreides, we believe that teams work best when they:Remain curious and passionate in all aspects of our workPromote clear, direct, and transparent communicationEmbrace the 'measure twice, cut once' philosophyValue and encourage diverse ideas and technologiesLead with empathy in all interactionsResponsibilities:Design, develop, and maintain scalable data pipelines using Spark, Scala, Java and Python. Nice to have: GolangImplement and manage Iceberg tables for efficient data storage and retrievalImplement and manage Iceberg tables and ensure efficient data storage and retrievalDevelop and enforce data retention policies and ensure compliance with data governance standardsWork with Postgres, GraphQL, and other data manipulation tools.Collaborate with infrastructure engineers to integrate data processes with AWS infrastructure and automation toolsEnsure data security and implement necessary measures to protect sensitive informationMonitor and troubleshoot data pipelines to ensure high availability and performanceDocument data engineering processes and maintain comprehensive documentationQualifications:Required Canadian Citizenship3+ years of experience in data engineering or related rolesProficiency in Spark, Scala, Java, and Python. Nice to have: GolangExperience with Postgres, GraphQL, and other data manipulation toolsStrong understanding of data optimization, storage solutions, and data retention policiesFamiliarity with AWS or Azure infrastructure and site reliability engineering principles. AWS/Azure Data Eng/DevOps Associate or Professional AWS/Azure certificates are a plus.Knowledge of big data tools and environments, having previously worked with at least 100TB of data at production scaleFamiliarity with geospatial data formats such as Parquet/GeoParquet, GeoJSON, and Shapefiles is a plus. Visualization of geospatial data to facilitate understanding with Analysts and End Users a plus.proven experience in implementing and managing Iceberg tables for efficient data storage and retrievalExperience with data orchestration tools such as Airflow, Prefect, Dagster, or TemporalExcellent problem-solving skills and the ability to think quickly in a high-performance environmentEffective communication skills to convey technical concepts to both technical and non-technical stakeholdersExperience with Apache Iceberg Tables desiredCompensation and Benefits:?Competitive salary?Comprehensive health, dental, and vision insurance plans?Flexible hybrid work environment?Additional benefits like flexible hours, work travel opportunities, competitive vacation time and parental leave