IDDENP26 - ID Data Eng and Governance Prof (Software Engineering Lead)

ESS-189

Job Title: Software Engineering Lead – Azure Data Lake & Databricks

Location: Glendale, AZ
Security Clearance: U.S. Citizenship Required – No exceptions
Employment Type: Full-Time

Job Summary:

We are seeking a highly experienced and technically skilled Software Engineering Lead to drive the strategy, design, and implementation of scalable data solutions within our Azure Data Lake and Databricks environments. The successful candidate will possess deep architecture-level knowledge of modern data platforms, with proven experience leading engineering teams in delivering secure and high-performance cloud-native data ecosystems.

This role plays a critical part in shaping our enterprise data architecture, implementing data governance and security best practices, and enabling cross-functional teams to turn data into actionable insights.

Key Responsibilities:

Architectural Design & Implementation:

• Lead the design and delivery of robust and scalable data platforms using Azure Data Lake, Databricks, and other Azure services .
• Define data architecture standards, best practices, and patterns for ingestion, storage, processing, and access.
• Ensure performance, cost-efficiency, and reusability across data pipelines and environments.

Data Governance & Security:

• Implement enterprise-grade security solutions including encryption, RBAC, and Azure subscription/resource management.
• Partner with InfoSec and Compliance teams to maintain regulatory alignment (GDPR, HIPAA, etc.).
• Conduct risk assessments and enforce proactive security and data lifecycle policies.

Team Leadership & Agile Delivery:

• Manage and mentor a team of data engineers and developers.
• Drive agile planning, sprint execution, and team velocity.
• Foster collaboration with Data Scientists, Business Analysts, DevOps, and Product Owners to meet business goals.

Platform Optimization & Monitoring:

• Oversee provisioning, deployment, and tuning of Azure Data Lake and Databricks environments.
• Set up proactive monitoring, alerting, and logging for performance and reliability assurance.
• Evaluate emerging technologies to evolve and optimize the data platform.

Strategic Roadmap & Innovation:

• Define and maintain a roadmap for scalable, secure, and innovative data engineering capabilities.
• Lead initiatives on lakehouse architectures , data democratization, and cost optimization.
• Keep abreast of Azure’s evolving service offerings and translate them into business value.

Required Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.
• 8+ years of experience in data engineering, with at least 3 years in a leadership role .
• Hands-on expertise with Azure Data Lake , Azure Databricks , and other core Azure PaaS services.
• Strong understanding of data security , RBAC, subscription governance, and regulatory compliance.
• Solid experience with SQL , ETL pipelines , data modeling , and cloud-native big data tools.
• Familiarity with CI/CD and DevOps practices in a data engineering environment.
• U.S. Citizenship is required.
  
  

Preferred Qualifications:

• Azure certifications such as:
  • Azure Data Engineer Associate
  • Azure Solutions Architect Expert
• Experience implementing data lakehouse architecture (Delta Lake, Unity Catalog, etc.).
• Understanding of data governance frameworks (e.g., GDPR, CCPA, HIPAA).
• Proficiency in Python, Scala, or Spark-based frameworks in Azure environments.

Core Competencies:

• Strong leadership and team development abilities.
• Strategic thinking with a proactive, solution-oriented mindset.
• Excellent written and verbal communication and stakeholder engagement skills.
• Proven ability to lead complex projects from ideation through delivery in an Agile environment.

Why Join Us:

This is an exciting opportunity to lead cutting-edge cloud data engineering initiatives with strategic impact across the enterprise. If you're a data leader passionate about innovation, security, and driving business value through technology—this role is for you.

Environmental and Safety Solutions Inc. (ESS Inc.) is a Cincinnati based certified MBE. Since 2002, ESS Inc. has been providing health and safety, engineering, environmental technical and management services to businesses throughout the United States. We work with businesses from Fortune 500 members to small businesses in the local community, providing world class occupational safety and health consultative services and environmental compliance assistance. Our customers value our personal attention to their needs and the accuracy and flexibility of our services to meet their unique needs.

Environmental and Safety Solutions Inc. (ESS Inc.) is a Cincinnati based certified MBE. Since 2002, ESS Inc. has been providing health and safety, engineering, environmental technical and management services to businesses throughout the United States. We work with businesses from Fortune 500 members to small businesses in the local community, providing world class occupational safety and health consultative services and environmental compliance assistance. Our customers value our personal attention to their needs and the accuracy and flexibility of our services to meet their unique needs. As President and Founder of ESS, Lonnie Grayson brings more than 25 years of professional environmental safety and health leadership to the company. He founded ESS Inc. in 2002 and has grown the firm into a nationally recognized industry leader. With a professional background as a mechanical engineer, Mr. Grayson knows the value of a safety and health program that focuses on the processes that drive the safety and health process in a company to achieve great results. We understand the need for partnership with our customers to fully understand their needs and the culture of each customer to meet and exceed their occupational safety, health and environmental compliance needs.