BI Data Engineer

The role

I am looking for a BI Data Engineer to join my client on a full-time basis. Your role as BI Data Engineer will be to coordinate and help with a hands-on approach the extraction of domain specific data from transactional databases into data lakes to power the BI analytics pipelines.



What's in it for you?

* Work with the latest cutting-edge technologies
* Disrupt a centuries-old industry in a start-up environment
* Great team spirit with established structure and quick decision-making
* Deliver projects as green field applications
* Solve complex problems, never run out of challenging projects to tackle
* Great culture where each contributor can make a significant change and bring added value
* Work-life balance with a remote-first culture
* Flexibility to organise your work the way you like using our remote-first setup
* No approval loops, quick decision-making and full ownership of your function
* Variety of knowledge-sharing and self-development opportunities
* Competitive salary Responsibilities

General:

* Ensure effectiveness and efficiency at scale of data pipelines
* Help product teams with data extraction
* Help domain expert with data analysis
* Ensure data security
* Monitor and ensure reliability for all data pipelines
* Ensure Company best practices deliver production-ready, industry-quality code
* Participate in technical interviews From time-to-time:
* Mentor, coach and develop engineers
* Help teams plan and deliver complex releases
* Help colleagues with hard technical challenges Requirements
* Deep understanding of database technologies and design data intensive applications
* Understanding ofstatisticsFull hands-on technical experience * Database experience:

* SQL (Postgres)
* Kafka and high frequency data

* Proficiency in: o AWS data lakes technology: DMS, S3, Parquet, Lake Formation, Glue, Athena, IAM o spark/pySpark o AWS QuickSight o Golang or Python o Data pipeline design
* Ability to perform basic DevOps tasks
* Use of Unix systems commands
* Experience with monitoring services
* Advanced use of Git Experience

Demonstrated track record and proficiency in:

* Delivering features autonomously with a high degree of team coordination
* Delivering features based on precise architecture spec
* Delivering features without relying on precise architecture spec
* Working with CI/CD practices
* Delivering features into production
* Maintaining production-ready code
* Collaborating in small, fast-paced teams
* Event-driven architecture and message passing Nice to have experience in:
* Improving systems' performance and security
* Project management
* High-throughput data processing
* Experience with MongoDB and Cassandra More about you
* Proficient level of English, spoken and written
* Excellent all-round communication skills
* Willingness to learn and an open mind about new technologies
* Confident in operating in a fast-paced environment
* A collaborative approach and willingness to engage in an environment of active ideassharing
* Ability to learn autonomously



Jefferson Frank is the Amazon Web Services (AWS) recruiter of choice. We work with organizations worldwide to find and deliver the best AWS professionals on the planet. Backed by private equity firm TPG Growth, we have a proven track record servicing the AWS recruitment market and, to date, have worked with over 30,000 organizations globally.