Sr, D, A?t? N
Posted 2025-04-18
Remote, USA
Part Time
Immediate Start
Description:
• Wizard is revolutionizing the shopping experience using generative AI and messaging technologies.
• Seeking a Senior Data Engineer to enhance data collection, storage, and analysis capabilities.
• This position is critical for strengthening data infrastructure for data-driven decision making and growth initiatives.
• Develop and maintain scalable data infrastructure for batch and real-time data processing.
• Build and optimize ETL pipelines for efficient data flow and accessibility.
• Collaborate with data scientists and cross-functional teams for accurate monitoring and analysis.
• Design backend data solutions for microservices architecture, ensuring seamless integration.
• Implement and manage integrations with third-party e-commerce platforms.
Requirements:
• 5+ years of professional experience in software development with a strong focus on data engineering.
• Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
• Proficiency in Python with experience implementing software engineering best practices.
• Strong expertise in building ETL pipelines using tools such as Apache Spark, Databricks, or Hadoop (Spark experience is required).
• Solid understanding of distributed computing and data modeling for scalable systems.
• Hands-on experience with NoSQL databases like MongoDB, Cassandra, DynamoDB, or CosmosDB.
• Proficiency in real-time stream processing systems such as Kafka, AWS Kinesis, or GCP Data Flow.
• Experience with Delta Lake, Parquet files, and cloud platforms (AWS, GCP, or Azure).
• Familiarity with caching and search technologies such as Redis, Elasticsearch, or Solr.
• Knowledge of message queuing systems like RabbitMQ, AWS SQS, or GCP Cloud Tasks.
• Advocate for Test-Driven Development (TDD) and experienced in using version control tools like GitHub or Bitbucket.
Benefits:
Apply Job!
Apply To This Job
Check More Jobs
• Wizard is revolutionizing the shopping experience using generative AI and messaging technologies.
• Seeking a Senior Data Engineer to enhance data collection, storage, and analysis capabilities.
• This position is critical for strengthening data infrastructure for data-driven decision making and growth initiatives.
• Develop and maintain scalable data infrastructure for batch and real-time data processing.
• Build and optimize ETL pipelines for efficient data flow and accessibility.
• Collaborate with data scientists and cross-functional teams for accurate monitoring and analysis.
• Design backend data solutions for microservices architecture, ensuring seamless integration.
• Implement and manage integrations with third-party e-commerce platforms.
Requirements:
• 5+ years of professional experience in software development with a strong focus on data engineering.
• Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
• Proficiency in Python with experience implementing software engineering best practices.
• Strong expertise in building ETL pipelines using tools such as Apache Spark, Databricks, or Hadoop (Spark experience is required).
• Solid understanding of distributed computing and data modeling for scalable systems.
• Hands-on experience with NoSQL databases like MongoDB, Cassandra, DynamoDB, or CosmosDB.
• Proficiency in real-time stream processing systems such as Kafka, AWS Kinesis, or GCP Data Flow.
• Experience with Delta Lake, Parquet files, and cloud platforms (AWS, GCP, or Azure).
• Familiarity with caching and search technologies such as Redis, Elasticsearch, or Solr.
• Knowledge of message queuing systems like RabbitMQ, AWS SQS, or GCP Cloud Tasks.
• Advocate for Test-Driven Development (TDD) and experienced in using version control tools like GitHub or Bitbucket.
Benefits:
Apply Job!
Apply To This Job
Check More Jobs