Data engineer

abraCenter, Center District, Remote, Hybrid

Mid-levelHybridFull-timeData

Apply on the employer’s site

Confirmed open at the employer 1 hour ago · Posted 15 days ago

Listing published by its original source and linked back to it. The employer did not pay Jobsworm for this listing.

Requirements

statisticspythonoopsparkdelta lakedockerlinuxci/cdkubernetesdata pipelineairflowkubeflowmachine learning

Job description

Description

abra professional services is seeking a talented Data Engineer!

We are looking for a Data Engineer to join our team and work on cutting-edge AI projects.

In this role, you will be responsible for ingesting large volumes of new data, as well as deeply understanding and analyzing it in close collaboration with our Data Scientists. You will design and develop critical, diverse, and large-scale data pipelines across both Cloud and On-Premises environments.

Requirements

Education: B.Sc. in Computer Science, Engineering, Mathematics, or Statistics – Must.
Experience: 3+ years of hands-on experience as a Data Engineer – Must.
Programming: 3+ years of experience with Python and Object-Oriented Programming (OOP) – Must.
Big Data: Proven practical experience with Spark for large-scale data processing – Must.
Deep understanding of designing, developing, and optimizing complex high-volume data systems.
Familiarity with data formats and optimization/partitioning techniques (Parquet, Avro, HDF5, Delta Lake).
Solid conceptual and practical understanding of Docker, Linux, CI/CD tools, and Kubernetes.
Experience with data pipeline orchestration tools such as Airflow or Kubeflow.
Understanding of core Machine Learning concepts and workflows.

Listing published by its original source and linked back to it. Jobsworm does not receive payment from employers.