About Us:
Join our dynamic team at a rapidly growing tech company in the heart of Stockholm! We cater to millions of daily users, and we're on the lookout for a skilled Big Data Engineer with expertise in Kafka and Hadoop to help us unlock the full potential of our data and drive innovation.
Job Description:
As a Big Data Engineer specialising in Kafka and Hadoop, you will be a key contributor to our data-driven journey. You'll play a vital role in designing, developing, and maintaining our big data infrastructure, ensuring the smooth flow of data and enabling our data scientists and analysts to derive valuable insights.
Key Responsibilities:
* Design and implement data pipelines using Kafka for real-time data streaming.
* Develop and manage data storage and processing solutions with Hadoop.
* Collaborate closely with data scientists to optimize data extraction, transformation, and loading processes.
* Ensure data quality, consistency, and security.
* Monitor and maintain the performance, availability, and scalability of our big data ecosystem.
* Automate routine tasks to improve system reliability and efficiency.
* Troubleshoot and resolve data-related issues.
* Document processes and best practices to facilitate knowledge transfer.
Requirements:
* Proven experience as a Big Data Engineer with a focus on Kafka and Hadoop.
* Strong proficiency in configuring, deploying, and managing Kafka and Hadoop clusters.
* Knowledge of streaming data technologies, ETL processes, and data warehousing.
* Scripting and automation skills (e.g., Python, Shell).
* Familiarity with containerisation and orchestration (Docker, Kubernetes).
* Experience with infrastructure as code (IaC) tools (e.g., Terraform).
* Exceptional troubleshooting and problem-solving abilities.
* Strong communication and collaboration skills.
* Relevant certifications in big data technologies are a plus.
Benefits:
* Competitive compensation and performance-based bonuses.
* Opportunities for professional development and continued learning.
* A vibrant, innovative, and collaborative work environment.
* Health, dental, and retirement benefits.
If you are a motivated Big Data Engineer with expertise in Kafka and Hadoop and are ready to make a meaningful impact on a growing tech company in Stockholm, we want to hear from you. Apply now and be a part of our exciting journey into the world of data-driven insights.
