Databricks Data Engineer
- Design, build, and maintain data pipelines and data engineering solutions using Databricks, Apache Spark, Python, and Structured Query Language (SQL)
- Support the modernization of enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns
- Develop and maintain batch and streaming data workflows that support reporting, analytics, and artificial intelligence use cases
- Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance
- Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs
- A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
- Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
- 3+ years of experience in data engineering, extract, transform, load (ETL) development, or data platform engineering
- 2+ years of experience building data pipelines in Databricks using Apache Spark, Python, and Structured Query Language (SQL)
- Experience implementing data models, data integration patterns, and cloud-based data processing workflows
- Experience working with at least one cloud platform: Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
- Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Experience using Git-based version control and continuous integration/continuous deployment pipelines
- Experience supporting batch and streaming data workloads
- Experience with data warehousing, lakehouse architecture, and performance optimization
- Experience supporting analytics or machine learning data pipelines
- Experience working in consulting or client service delivery environments
Recommended Jobs
As-Built Technician I (SWG)
Short Description: Bowman has an opportunity for an As-Built Technician to join our team in Tempe, AZ. At Bowman, we believe in creating opportunities for aspiring people to thrive and achieve amb…
Generator Field Technician
We are currently hiring for the position of Generator Technician. As a Generator Technician, you will be responsible for installing, maintaining, and repairing generators and their related systems. W…
DRIVE YOUR FUTURE FORWARD&BECOME A PROFESSIONAL TRUCK DRIVER
Job Description Job Description Drive Your Future Forward - Become a Professional Truck Driver! Tired of the 9-to-5 grind? Ready to earn BIG while seeing the country? Join one of America's mo…
Occupational Health Nurse
Requisition Number: 74499 The company built on breakthroughs. Join us. Corning is one of the world’s leading innovators in glass, ceramic, and materials science. From the d…
PWM Registered Client Service Associate
: PWM Registered Client Service Associate Job Number: 3247199 POSTING DATE: Mar 26, 2024 PRIMARY LOCATION: Americas-United States of America-Arizona-Scottsdale EDUCATION LEVEL: Refer to Position…
Adult Case Manager (East Valley)
Adult SMI Case Manager: The Adult Case Manager provides ongoing case management services to members designated as Seriously Mentally Ill (SMI) who are receiving ongoing behavioral and integrated heal…
School Nurse
The school nurse aids children and youth in developing their full potential in health and education. She/he works as a part of the total school health service program planned by the school in coopera…
IT Project and Deployment Coordinator 1.19
90661 - IT Project and Deployment Coordinator - Phoenix, AZ This position is 95% remote work and 5% onsite work. On-site work is located at Phoenix, AZ 85007 Our direct client has an openin…
Associate Attorney
Job Description Job Description Join Tyson & Mendes – Where Insurance Defense Meets Innovation Associate Attorney Please note: An active bar license in the State of Arizona is required. …
Structural Engineering Professional (39129)
Advanced Manufacturing At Jacobs, we're challenging today to reinvent tomorrow by solving the world's most critical…