Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Data Engineering
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are seeking a highly experienced Assistant Manager / Manger with strong expertise in ETL, Big Data platforms.The ideal candidate will lead the design, development, and operational support of enterprise-scale data pipelines while also enabling metadata management.
Job Title: Assistant Manager/Manger – Data Engineering
Roles & Responsibilities:
1. Data Architecture & Solution Design
Analyze business requirements and source systems to design scalable, reliable ETL and data integration solutions.
Architect end-to-end data pipelines for batch and near real-time ingestion from heterogeneous sources such as RDBMS, APIs, flat files, and streaming platforms.
Define data mappings, transformation rules, aggregation logic, and reconciliation frameworks.
Design incremental load strategies, CDC pipelines, and large-scale data ingestion frameworks.
2. ETL Development & Optimization
Lead development of complex ETL pipelines using Informatica Big Data Management (BDM).
Design scalable data ingestion frameworks into enterprise data lakes and warehouses.
Develop and optimize big data workloads on Cloudera Hadoop ecosystem including:
o HDFS
o Hive
o Spark
o Impala
o Sqoop
Write advanced SQL and PL/SQL for large-scale data transformations.
Implement partitioning, indexing, and parallel processing strategies.
Conduct code reviews and enforce reusable ETL development standards.
Continuously optimize performance for high-volume batch workloads.
Professional & Technical Skills:
8+ Years (Minimum 2+ years in Team Lead / Support role)
3. Production Support & Incident Management
Monitor and support ETL workflows developed in Informatica Big Data Management.
Manage batch scheduling using enterprise tools such as:
o AutoSys
o Control-M
o Stonebranch
o Unix Cron
Investigate and resolve:
o Session failures
o Workflow aborts
o Long-running jobs
o Data mismatches and reconciliation issues
Perform root cause analysis (RCA) and implement preventive solutions.
Coordinate with upstream and downstream application teams for issue resolution.
Participate in on-call rotations and L1/L2 production support.
Ensure adherence to SLAs and operational compliance standards.
4. Must-Have Skills
ETL & Data Integration
o Strong expertise in Informatica Big Data Management
o Deep understanding of enterprise ETL design patterns
Big Data & Hadoop Ecosystem
Hands-on experience with:
o Apache Hive
o Apache Spark
o Apache Impala
o Apache Sqoop
Experience working on Cloudera Data Platform
Additional Information:
- The candidate should have minimum 7.5 years of experience in Data Engineering.
- This position is based at our Chennai office.
- A 15 years full time education is required.
Chennai
平等就业机会声明
所有聘用决定均不考虑年龄、种族、信仰、肤色、宗教、性别、国籍、血统、残疾状况、退伍军人身份、性取向、性别认同或表达、基因信息、婚姻状况、公民身份或任何其他受联邦、州或地方法律保护的因素。
求职者在招聘过程中没有义务披露已封存或已删除的定罪或逮捕记录。
埃森哲致力于为我们的男女军人提供退伍军人就业机会。
请阅读埃森哲的招聘和聘用声明，了解更多关于我们在招聘和聘用过程中如何处理您的数据的信息。
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.