Data Engineer (Research)

Job Description

REQUIREMENTS

• At least 3 years of experience as a Data Engineer or in a related software engineering role.
• Proficiency in Python and the ability to write clean, testable production code.
• Hands-on experience with Apache Spark.
• Advanced SQL skills (query optimization on large datasets).
• Strong understanding of data warehouse design principles and data modeling.
• Practical knowledge of ETL/ELT processes.
• Familiarity with data quality, monitoring, and pipeline reliability.
• Experience working with relational databases, including an understanding of how they work, data modeling, and optimization.
• Understanding of REST and gRPC standards for system integration.
• Experience with workflow orchestration tools (e.g., Airflow, Dagster, or similar).
• Knowledge of CI/CD pipeline building and maintenance principles.
• Strong analytical problem-solving skills and attention to detail.
• Effective communication skills and the ability to collaborate in a team.
• Openness to learning and exploring new technologies and methodologies.

Nice to have

• Experience with dbt.
• Experience with Kafka, Pub/Sub, or other event streaming systems.
• Experience building near-real-time / real-time pipelines.
• Experience working with Infrastructure-as-Code tools.
• Understanding of CDC (Change Data Capture) and data integration from transactional systems.
• Experience with Databricks or other lakehouse platforms.

RESPONSIBILITES

• Designing, building, and maintaining scalable data processing pipelines using SQL, Python, and Apache Spark / PySpark.
• Working with raw data and designing methods for its integration into the data platform.
• Developing CI/CD pipelines for data engineering solutions.
• Creating and maintaining Infrastructure as Code solutions.
• Integrating the data platform with other systems and applications.
• Participating in architectural decision-making and defining engineering standards.
• Conducting code reviews, documenting solutions, and sharing knowledge with team members.

Are you interested in this position?

Apply by clicking on the “Apply Now” button below!

#CrossChannelJobs #JobSearch
#CareerOpportunities #HiringNow
#Employment #JobOpenings
#JobSeekers