Data Engineer H/FCompany:
Tata Consultancy Services (TCS) is an IT services, consulting and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. As part of the Tata group, India’s largest multinational business group - TCS has over 614,000 of the world’s best-trained consultants in 55 countries.
TCS France is serving over 80 customers (reputed brands and part of CAC40) in France for over 28 years with 1,500 employees with investments spanning across regions in an innovation center and multiple delivery centers. TCS France has delivered double-digit growth for over 5 years supporting customers in digital transformation, Data and cloud journeys.
Technical/Behavioral Competency :
Data Engineer with Python/Azure / DataBricks +Industrial Data Experience
Proficiency in Azure Databricks, SQL Databases
Expertise in Data Ingestion from OT Systems like SCADA, PLC, and DCS systems
Strong knowledge of data warehousing concepts, ETL (Extract, Transform, Load) processes, and data modeling.
Proficiency in Pyspark, and potentially other scripting languages like Python, PowerShell for data manipulation and automation
Familiarity of Cognite Data Fusion application
Familiarity with cloud platforms like Azure and Cognite Data Platform
Deep understanding of industrial protocols, SCADA systems, PLCs, DCS systems, and their associated security considerations.
Some experience of Energy/Oil & Gas domain
Responsibility of / Expectations from the Role :
Designing and implementing efficient data pipelines to move data from various OT sources (e.g., SCADA, PLC, DCS systems) to data lakes, data warehouses, or other storage systems
Strong communication skills to collaborate effectively with other team members, and to explain complex technical concepts to non-technical stakeholders
Integrating data from disparate OT systems, often using a variety of protocols and formats, into a unified data model.
Ensuring the accuracy, completeness, and consistency of data used for analysis and decision-making.
Working closely with IT and OT teams, as well as other stakeholders, to ensure alignment and effective data management practices.
Monitoring data pipelines and OT systems for performance issues and security vulnerabilities, and proactively addressing any problems
Creating and maintaining documentation for data pipelines, data models, and security procedures
Desired Experience:
6-10 Years