Data Architect
- Strong hands-on experience in Big Data technologies and distributed data processing frameworks.
- Proficiency in Python for data engineering, scripting, and performance optimization.
- Extensive experience with Apache Spark (PySpark/Spark SQL) for large-scale data transformation and processing.
- Solid experience in designing and developing ETL/ELT pipelines for batch and real-time data processing.
- Experience working with Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Composer, and Pub/Sub.
- Strong understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
- Experience with CI/CD pipelines and DevOps practices for data engineering workflows.
- Proficiency in version control systems (Git) and build/release management.
- Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.
- Experience working in Agile/Scrum environments with cross-functional teams.
- Strong analytical and problem-solving skills
- Strong collaboration and stakeholder communication skills
- Design, develop, and maintain scalable Big Data pipelines using Spark (PySpark/Spark SQL) for batch and real-time processing.
- Build and optimize robust ETL/ELT workflows to ingest, transform, and load data from multiple structured and unstructured sources.
- Develop high-performance SQL queries and implement efficient data models to support analytics and reporting needs.
- Architect and implement data solutions on Google Cloud Platform (GCP) using services such as BigQuery, Dataproc, Dataflow, Cloud Storage, Pub/Sub, and Composer.
- Monitor, troubleshoot, and resolve production issues in distributed and cloud environments.
- Automate operational processes and enforce coding standards, version control, and documentation practices.
- Automate operational processes and enforce coding standards, version control, and documentation practices.
- Collaborate with cross-functional teams including business stakeholders, data engineers, and product teams
- Drive analytics initiatives to provide actionable insights.
- Participate in Agile ceremonies including sprint planning, design reviews, and retrospectives.
- Continuously improve reporting frameworks and data processes in alignment with Agile delivery practices
Recommended Jobs
Senior Information Technology Manager
Job Description Job Description As a Barron’s Top 100 RIA firm and voted Best Places to Work by Fortune, Pacific Coast Business Times, Inc. (Best Workplaces), and Investment News, Mission Wealth …
Medical Optometrist - Lake Havasu, AZ
Job Description Job Description Overview ABOUT THE PRACTICE: Voted #1 Eye Care Center in Arizona from 2013-2021, Barnet Dulaney Perkins Eye Center has been providing world-class eye care in…
Steward/Dishwasher | Full Time
Description The Hotel: Connect to the heart of the West and embrace the captivating optimism of the Sonoran Desert at Grand Hyatt Scottsdale Resort. The richly appointed property and sophistic…
System Integration Engineer
A VirTra System Integration Engineer determines which computing hardware components and system configurations will deliver the highest simulation performance, reliability, and compatibility, and then…
Senior Water Resources Engineer
Why Black and Veatch At Black & Veatch, you have the opportunity to contribute your talent and perspective to tackling humanity’s greatest challenges in a flexible environment that empowers you to…
Sales and Front Desk Superstar
Are you a people person with a flair for sales, impeccable organizational skills, and a passion for creating an exceptional customer experience? Spenga Tucson is on the lookout for a Sales and Front D…
RevOps Specialist
VAST Data is looking for a RevOps Specialist to join our growing team! Due to the requirements of this role, this individual MUST be a US Citizen ONLY. This is a great opportunity to be part o…
Sales Representative - EV Chargers (Technology-Focused Sales Role)
Minit Charger is a Chandler, Arizona-based company specializing in industrial smart EV charging solutions, including fast chargers for material handling equipment (MHE like forklifts), ground suppor…
Quality Assurance Manager
The Quality Assurance Manager at Proweaver plays a critical role in ensuring that our products and services meet established quality standards. In this position, you will be tasked with the developme…
Operations Manager - Customer Experience
Operations Manager – Customer Experience Location : Desert Ridge, AZ Employment Type : Full-Time Compensation: $90,000+ annually Ove rview Lead operations in a fast-paced, hig…