Databricks Data Engineer

Навыки

• AWS
• Azure
• Коммуникация
• Решения на данных
• Data Governance
• Data Lake
• Data Quality

О компании и продукте

• Devoteam is a leading consulting firm focused on digital transformation. We help our clients leverage technology to achieve their business goals.
• Our longstanding partnerships with leaders like AWS, Google Cloud, Microsoft, and ServiceNow amplify our capabilities, allowing us to deliver top-tier expertise and award-winning services. We complement these partnerships with in-depth Cyber, Data & AI, Software development and multi cloud expertise.
• For 30 years, we have always been guiding our customers on the next tech wave . Devoteam has guided organizations through the Internet and cloud. The next revolution? AI.
• With 11,000 tech natives working in 25+ countries, we bring you highly skilled IT experts across Europe

Задачи

• Data Pipeline Engineering: Design, develop, and deploy robust and scalable data pipelines using Databricks, incorporating data extraction from diverse sources (databases, APIs, streaming platforms), transformation and cleansing using Spark, and loading into target systems (data lakes, data warehouses, etc.)
• Optimize pipeline performance for efficiency and cost-effectiveness
• Databricks Ecosystem Expertise: Utilize the full capabilities of the Databricks platform, including Databricks SQL, Delta Lake, Databricks Runtime, and Databricks Workflows, to orchestrate complex data workflows and ensure data quality and pipeline reliability
• Cloud Integration: Seamlessly integrate Databricks with cloud services (Azure, AWS, or GCP) for storage, compute, and security, leveraging services like Azure Data Lake Storage, AWS S3, Google Cloud Storage, and more
• Data Architecture and Modeling: Contribute to the design and implementation of robust data models and architectures for data lakes and data warehouses, ensuring data consistency, integrity, and accessibility for various use cases
• Data Quality Assurance: Implement rigorous data quality checks and validation procedures throughout the data pipeline to maintain high accuracy and reliability
• Adhere to data governance policies and best practices
• Collaboration and Communication: Work closely with data scientists, analysts, business intelligence specialists, and business stakeholders to understand their data requirements and provide technical expertise on Databricks and data engineering best practices
• Continuous Learning: Stay up to date with the latest Databricks features, cloud technologies, and data engineering trends to continuously improve our solutions and deliver innovative results for our clients
• Data Fundamentals: Solid understanding of data warehousing principles, ETL processes, data modeling techniques, and database systems
• SQL Expertise: Advanced SQL skills for data querying, transformation, and analysis
• Problem-Solving: Strong analytical and problem-solving abilities, with a proactive approach to identifying and resolving data-related challenges

Требования

• Hold a University Degree in Computer Science, (Business) Engineering, or a specialized master's in Machine Learning or AI
• Proven Experience: 3+ years of experience as a Data Engineer with demonstrated expertise in Databricks
• Cloud Proficiency: Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP), with a good understanding of cloud data services and infrastructure
• Programming Skills: Strong programming skills in Python or Scala, with experience in data manipulation libraries (e.g., PySpark, Spark SQL)
• Communication Skills: Excellent communication and interpersonal skills, with the ability to effectively collaborate with technical and non-technical stakeholders
• Fluent in English and proficiency in Dutch or French is mandatory

Будет плюсом

• Experience with machine learning or AI technologies
• Knowledge of DevOps practices
• Contributions to open-source projects
• Experience with data visualization tools (e.g., Tableau, Power BI)
• Why choose us?
• Thrive in a fast-growing, entrepreneurial environment
• Work with innovative and impactful Cloud, Data & AI projects for industry-leading clients
• Connect with extraordinary talents in a collaborative and diverse culture
• Enjoy a healthy work-life balance in an inspiring, eco-friendly workplace
• Competitive compensation package
• At Devoteam, we combine strong values – respect, frankness, ambition, entrepreneurship & collaboration – with a fun and supportive environment that empowers you to innovate, grow, and succeed in the fast-paced world of Cloud, Data & AI

Паспорт вакансии

История публикации

Откуда что взялось

Отмечено то, что вывели мы. Без пометки — значение назвал работодатель.

Почему на этом месте в выдаче

Порядок выдачи объявлен контрактом: свежесть решает между днями, полнота и зарплата — внутри дня.