Lead Big Data Engineer
* Build data-intensive solutions on AWS/GCP/Azure to help customers transition to cloud
* Collaborate with data scientists to design and deploy solutions on cloud
* Design data layout using object storage (S3/Cloud Storage) or databases to enable spark and other processes to access data efficiently
* Keep abreast with latest technologies and apply them to solve big data problems
* Familiarity with containers and their orchestration to manage workloads
* Learn and contribute towards knowledge sharing sessions
* Automate solutions and improve overall productivity and reducing the cost footprint of resources.
* Identify and solve performance and scalability issues
* Understand business problems and propose technical solutions
* Work with a global development team to develop production solutions
* Sound understanding of cloud platforms and its service offerings (at least one of AWS/GCP/Azure)
* Strong programming background in either Python and SQL
* Strong understanding of data engineering, data warehousing concepts
* Knowledge of object storage like S3 and designing data layouts for efficient data access
* Familiarity with Spark and big data technologies like Hive, BQ,EMR, DataProc , Dataflow will be given extra consideration.
* Experience with container technology (Docker) is a plus.
* Prior experience with data visualization technologies like SAS VA, Tableau is a plus
* Education: Master's Degree in Computer Science or Equivalent
* Travel up to 25% is required
* 3 weeks PTO
* Looking to fill this position immediately. Contact me by email at email@example.com or call 813-437-6931.
* Jefferson Frank is the Amazon Web Services (AWS) recruiter of choice. We work with organizations worldwide to find and deliver the best AWS professional on the planet. Backed by private equity firm TPG Growth, we have a proven track record servicing the AWS permanent and contract recruitment market and, to date, have worked with over 30,000 organizations globally from our offices in North America, Europe, and Asia-Pacific.
* At Jefferson Frank, our mission is simple: we want happy customers. Whether you're an AWS professional walking into your dream AWS job, or an organization hiring an incredible contractor for your cloud migration project, our goal is to deliver an unrivaled customer experience. Work with us and you'll get the personalized experience you deserve- one you'll simply not find at any other recruitment agency. At Jefferson Frank, we find great people great jobs in AWS.