Big Data Engineer

Company: ITL USA Skills: Technology|DevOps|Continuous integration - Java, Technology|Java|Core Java Interest Group: Infosys Limited Country: USA Work Location: Phoenix, AZ, Raleigh, NC, Richardson, TX State / Region / Province: Arizona, North Carolina, Texas Domain: Consulting Requisition ID: 137894BR Job description Infosys is looking for Big Data Engineer who must be Polyglots with expertise in multiple technologies and can work as a full-stack developer in complex engineering projects. The ideal candidate has experience building products across the stack and a firm understanding of web frameworks, APIs, databases, and multiple back-end languages. The full stack developer will join a small team that uses new technology to solve challenges for both the front-end and back-end architecture, ultimately delivering amazing experiences for global users. **Required Qualifications:** Candidate must be located within traveling distance of Richardson, TX or Raleigh, NC or be willing to relocate to the area. Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. Deep expertise in Scala or Python for Spark application development along with Snowflake Experience in end-to-end implementation of projects using Cloudera Hadoop, snowflake, Spark, Hive, HBase, Sqoop, Kafka, Elasticsearch, Grafana, ELK stack Experience in Categorizing, cataloging, cleansing and normalizing of datasets. Providing users access to datasets using REST and Python APIs. Extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL and AWS technologies. Experience in leading the migration of enterprise-scale data pipelines and analytics workloads from Google BigQuery to Snowflake. Deep expertise in Snowflake architecture, SQL optimization, and data modeling, as well as hands-on experience with Big Query schemas, UDFs, and partitioning strategies. Experience in translating query logic, optimizing performance, and ensuring data integrity throughout the migration. Familiarity with orchestration tools (e.g., Airflow, dbt), secure data sharing, and compliance with financial data governance standards is essential. Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time **Preferred Qualifications:** Experience in data warehousing technologies, ETL/ELT implementations Sound Knowledge of Software engineering design patterns and practices Strong understanding of Functional programming. Experience with Ranger, Atlas, Tez, Hive LLAP, Neo4J, NiFi, Airflow, or any DAG based tools Knowledge and experience with Cloud and containerization technologies: Azure, Kubernetes, OpenShift and Dockers Experience with data visualization tools like Tableau, Kibana, etc Experience with design and implementation of ETL/ELT framework for complex warehouses/marts Knowledge of large data sets and experience with performance tuning and troubleshooting Building end-to-end data integration and data warehousing solutions for analytics teams. Planning and Co-ordination skills Experience and desire to work in a Global delivery environment. Ability to work in team in diverse/ multiple stakeholder environment. The job may also entail sitting as well as working at a computer for extended periods of time. Candidates should be able to effectively communicate by telephone, email, and face to face. **About Us** Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem. **Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.**