Senior Data Engineer

We fuse together exceptional talent who deliver outstanding software solutions. Our approach has helped us grow 60% in 2021, 94% in 2022, while in 2023 we joined forces with Insight, a Fortune 500 company and a leading solutions and systems integrator. With exciting growth plans and cutting-edge projects, there has never been a better time to join our incredible team.

ABOUT THE ROLE:

We are seeking a highly skilled and analytical Senior Data Engineer to join our growing Data & Analytics team. In this role, you will be instrumental in designing, building, and optimizing our next-generation data platform. You will lead the convergence of our established Databricks environments with our emerging Microsoft Fabric adoption strategy.

The ideal candidate is someone who feels equally at home writing highly optimized PySpark/SQL code in Databricks notebooks as they are architecting end-to-end Lakehouse solutions within MS Fabric utilizing OneLake, Data Factory, and Synapse Data Engineering.

KEY RESPONSIBILITES:

Data Pipeline Engineering & Architecture

Design & Build: Develop scalable, robust batch and streaming ETL/ELT pipelines using PySpark, Scala, and SQL across both Databricks and Microsoft Fabric environments.

Lakehouse Implementation: Implement and maintain the Medallion Architecture (Bronze, Silver, Gold layers) ensuring ACID compliance and schema enforcement using Delta Lake.

Data Integration: Ingest and unify structured, semi-structured, and unstructured data from diverse enterprise sources (e.g., ERPs, CRMs, APIs, Webhooks).

Platform Optimization & Governance

Performance Tuning: Optimize Databricks cluster utilization and Spark jobs (partitioning, caching, memory management).

Capacity Management: Monitor and manage Fabric capacity utilization, workspace sizing, and Compute Unit (CU) consumption to ensure cost-effective operations.

Data Governance: Enforce data security, lineage, and compliance frameworks utilizing Databricks Unity Catalog, Microsoft Purview, and Fabric item-level/row-level security.

Analytics & Semantic Modeling

Semantic Layer: Design and optimize Fabric-native semantic models and Power BI Direct Lake configurations to ensure sub-second reporting performance.

Collaboration: Partner closely with Data Scientists, BI Developers, and business stakeholders to turn raw data into production-ready data products.

DataOps & Mentorship

CI/CD: Automate deployment pipelines for data workloads using Azure DevOps or GitHub Actions across Dev, Test, and Prod environments for both Databricks and Fabric workspaces.

Data Quality: Implement automated data quality frameworks to ensure data reliability and proactive monitoring.

Leadership: Provide technical mentorship, code reviews, and architectural guidance to junior and mid-level data engineers.

REQUIREMENTS:

• 5+ years of dedicated data engineering experience in an enterprise environment.
• Deep, hands-on experience with Azure Databricks, Delta Live Tables, Unity Catalog, Autoloader, and workflow orchestration.
• Proven hands-on exposure to the MS Fabric ecosystem, including OneLake, Fabric Lakehouses/Warehouses, Data Factory, and Dataflow Gen2.
• Expert-level proficiency in Python (PySpark) and SQL. Familiarity with Scala or Java is a major plus.
• Strong background in Azure cloud resources (ADLS Gen2, Azure Key Vault, Microsoft Entra ID).
• Strong understanding of dimensional modeling, Star Schemas, and Data Vault techniques.
  
  

Preferred Qualifications & Certifications

• Experience implementing Generative AI / Agentic AI data ingestion and vector database integration.
• Databricks Certified Data Engineer Professional.
• Microsoft Certified: Azure Data Engineer Associate (DP-203).
• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600).
  
  

Soft Skills

• Adaptive Mindset: Enthusiastic about navigating a rapidly evolving platform ecosystem (specifically Microsoft Fabric's growing capabilities).
• Communication: Ability to articulate complex data architecture and technical concepts to non-technical business stakeholders.
• Problem Solving: Strong root-cause analysis skills for troubleshooting complex pipeline failures, latency issues, and schema drift.
  
  

BENEFITS:

• You will work with amazing teammates from across Europe.
• Take a leading role in our newly-established Bulgarian center, contributing to the foundation of our future.
• Our Sofia office is right in the center, ensuring that everything you need is close by.
• Monthly transport allowance and enjoy the convenience of a dedicated parking area at the office.
• Enjoy 25 days of paid leave, we make sure you have plenty of time to relax and recharge.
• We've got you covered with additional premium health insurance and dental care, to keep you and your family protected.
• We offer food vouchers and to add a little extra you can enjoy complimentary meals in the office.
• Fully covered Multisport card that gives you access to a variety of fitness options to keep you active and feeling great.
• We support your growth with certifications and courses that help you advance your career.
• Join us for Social Events, Informal Office Gatherings and Team-building activities with your colleagues, where we celebrate our achievements together.
• We'll work with you on an individual plan to help you reach your career goals.
• Benefit from our coaching and mentorship programs, technological and professional guilds that offer guidance and support for your career journey.
• Participate in various social initiatives, contributing to causes that matter to you.
• Use our online platform, dedicated to your well-being and mental health.
• Enjoy the flexibility of our Work Abroad Policy, letting you work from another European country for a period of time.
• Refer a Friend, Get Rewarded.
  
  

To see more roles, click here.