Engineer II PySpark

Job Description

Job Description

Overview

CTG is seeking to fill a Engineer II PySpark opening for our client in Phoenix, AZ.

Location: Phoenix, AZ
Duration: Ongoing Contract

Duties:

• Design, develop, and optimize data processing pipelines using PySpark and Spark.

• Work with large-scale ETL processes for Big Data and Data Warehousing solutions.

• Integrate data sources and develop dashboards and reports in Tableau.

• Access and manage Cornerstone tables for data analysis and reporting.

• Utilize Python and Hive for data transformation, querying, and automation.

• Collaborate with stakeholders to understand reporting needs and deliver timely solutions.

• Implement CICD processes, version control (GitHub), and engineering best practices.

• Quickly learn and adapt to existing systems, reporting processes, and development environments.

Skills:

• PySpark

• Spark

• Python

• ETL – Big Data / Data Warehousing

• Tableau Developer

• Hive

• CICD, GitHub, Engineering Excellence

Experience:

• Strong, hands-on experience with PySpark and Spark-based development.

• Proven ability to work with Cornerstone tables and integrate with Tableau.

• Experience in Big Data ETL processes, Python programming, and Hive querying.

• Familiarity with CICD pipelines, GitHub workflows, and agile engineering practices.

Education:

• Bachelor’s degree in Computer Science, Information Systems, or related field preferred. Equivalent work experience will be considered.

Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.

CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services for this role.

To Apply:
To be considered, please apply directly to this requisition using the link provided. For additional information, please contact Anisha Muralidhar at [email protected] .

Kindly forward this to any other interested parties. Thank you!