Data Engineer (Azure Databricks + Python) – Remote

About the role

As a Data Engineer you will design and build scalable data pipelines on Azure Databricks, using Python to transform and enrich large datasets. You will also integrate large‑language‑model APIs and machine‑learning models to automate classification and generate actionable insights.

Key responsibilities

• Design, develop, and optimise end‑to‑end data pipelines and Lakehouse architectures on Azure Databricks.
• Integrate LLM APIs and ML models into data processing streams for automated classification.
• Write high‑quality Python code and SQL procedures for data transformation and ingestion.
• Collaborate with AI and product teams to deliver data‑driven solutions.
• Monitor pipeline performance, troubleshoot issues, and ensure reliability and scalability.
• Implement data‑governance and security best practices.

Required profile

• 4+ years of experience in Data Engineering, Machine Learning Engineering, or Software Engineering.
• Proven expertise with Azure Databricks and Python for building data pipelines.
• Experience integrating AI/ML solutions and LLM APIs into automated workflows.
• Strong background in data manipulation, automation, and classification tasks.
• Advanced proficiency in English.

Required skills

• Azure Databricks
• Python
• SQL
• LLM APIs
• Machine Learning integration
• Cloud‑native data architectures (Azure)

What we offer

• 100% remote work from anywhere.
• Competitive compensation in USD or local currency.
• Provided hardware and software setup for home office.
• Flexible hours and self‑managed schedule.
• Paid parental leave, vacations, and national holidays.
• Multicultural environment with mentorship, promotions, and skill development.