Data Engineer

Must have skills:Develop big data processing systems using Apache Spark, Airflow, Databricks, AWS and related technologies ETL and API'sUnderstand Continuous Integration (CI) and Delivery (CD) concepts, and capabilities to support automation, pipelines, virtualization, and containerization Fluency in one or more languages like Scala, Java, Python etc.Desired skills:Knowledge of Microservices and scaling techniquesExperience using web service APIs ETL pipeline to ingest data to a database which is fundamental to APIs (and hence the companies) to prevent fraudulent transactions and streamline account creation. The tech stack used by the team is enticing as we use Apace Spark, AWS and Databricks. The team has a healthy work culture where the team members support each other and work collaboratively.