استخدام Software Engineer (Data)

Software (Data) Engineer

What you’ll do

• Together with a few other chefs, you’ll help one of our clients with building data products. As an autonomous stream-aligned team, you might deal with a wide spectrum of tech from data warehouses, ETL/ELT pipelines, Event processing, and more.
• You’ll Design & code defensively for the real world and not for the happy path scenarios. Buckle up as you know, missing, late and low-quality raw data is a fact, and pipeline failures and replay/re-process are usual, not a drama.
• Your default is applying TDD to data engineering. You don’t deliver something that works sometimes/maybe. Got experience with the Great Expectations (DataChef is a contributor to the project) or Deequ? Perfecto!
• You’ll help with interviewing and selecting future chefs. We’ll train you on how to conduct effective, chef-style interviews!
• You’ll have a secondary focus area (select one), based on your passion and career plans:
• Tool developer: love coding? help us make our recipes!
•  Content developer: if you enjoy writing and sharing what we learned.
•  Baby-Chef developer: if you like to be a mentor at our Bootcamps for future chefs!

What you’ll bring

Good Consulting Skills

• 2+ years of experience in a consultative, client-facing consulting role.

• Motivated by client problems, and find joy in creating simple and elegant solutions that avoid unnecessary complexity.

• Relentlessly putting usefulness and adaptability above solving imaginary scaling issues.

• Passion for simplifying and clearly explaining complex topics in person and in writing.

• Excellent English communication skills, both written and verbal.

AWeSome Technical Skills

• Significant programming experience in Python or Scala, or Java.

• Solid computer science knowledge. Have you designed an $O(n)$ sorting Algorithm?! Send us your cocktail recipe (we don’t need your resume).

• Hands-on knowledge about Event-driven architectures and serverless-first solutions.

• Experience with data modeling on a technical level and domain modeling on a strategic level (DDD is praised and practiced here at DataChef)

• 2+ years of development experience using Spark (or Hadoop)

• 1+ years of development experience on Kafka

• 2+ years of hands-on experience with AWS Big Data, analytics, and serverless:

  Counted
  

   

• EMR Lambda / Step functions Glue Lake Formation Fargate / ECS / EKS

   

• Open Search MSK / Kinesis Event Bridge

  Not Counted
  

   

• S3 (common knowledge) IAM (ditto)

   

• EC2 (gimme a break!)

  AWS Networking (important but not our job) Once I logged into the console (kidding me?)

  We’d love you to have (extra nice)

• Experience in large-scale enterprise IT environments
• Kubernetes: not as a holy grail but as yet another tool that we might use sometimes.
• Contributed to open source: Make us happy with those green dots on GitHub!