Data Engineer

Job Title: Data Engineer Department: BNPP Personal finance About Business line/Function: BNP Paribas Personal Finance is financial entity specializing in consumer credit and banking as a service. Through our strong partners we distribute financial products on B2C, B2B2C and B2B models for different business lines. Inside Personal Finance, SET Iberia is an IT & Operations hub, providing IT, Data, Cybersecurity and Operations services to Personal Finance corporation, filières and subsidiaries. Position Purpose: Data Engineer will be an integral member of IT Data Tribe of an Extended Team. The engineer will be collaborating and working on key data projects to migrate data pipelines/processes from legacy platforms to Datahub, ensuring the robustness and scalability and following the guidelines and technologies of BNPP group. Responsibilities Direct Responsibilities: - Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service. - Implement data transformation and quality to ensure data consistency and accuracy. Utilize programming languages such as Scala and SQL and tools like Spark for data transformation and enrichment operations. - Set up CI/CD pipelines to automate deployments, unittestingand development management. - Write and conduct unit and validation tests to ensure accuracy and integrity of code developed. - Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as aService mainly). - Writing technical documentation (specifications, operational documents) to ensureknowledgecapitalization. Contributing Responsibilities: - Team player - Adhere to the standards and practices followed in the Project - Foster a culture of continuous learning and improvement within the team. - Collaborate with cross-functional teams to understand data requirements and deliver solutions. Technical & Behavioral Competencies Technical Skills - At least5 years of working experience inDataengineering - Working experience onSpark on Scala/Python/ Java(any of these languages) - KnowledgeonApache Airflow,Oozieor any other similar schedulertools - Strong knowledge of SQL and NoSQL databases - Good exposure to CI/CD tools (Gitlab, Jenkins…) - Knowledge of Kubernetes containerization - Integration experience with S3 storage/COS and parquet (and ORC) format - Hands onknowledge ofUnix shell script - Design effective prompts toleverageGen AI tools across IT domains (e.g., development, testing, data generation, documentation) during the development stage. - Nice tohave: exposureonany of the datavirtualizationtoollikeDremio - Nice tohave:exposure to Kafka, Elastic search, Kibana,Hvault - Nice to have: Working knowledge of HDFS, Hadoop and Hive Skills Referential (Required knowledge, skills and abilities) Other Skills: - Agilemethodologyexposure - Knowledge of banking products isa niceto have - Proactive mindset - Business / IT relationship (including IT OPS) Behavioral Skills: - Ability to understand, explain and support change - Ability to Deliver / Results driven - Ability to collaborate / Teamwork with data squads and business teams Education Level: - Bachelor’s orMaster’s degree in Engineering, Computer Science, Artificial Intelligence, Data Science or equivalent Location: Chennai About BNP Paribas Group: BNP Paribas is the European Union’s leading bank and key player in international banking. It operates in 65 countries and has nearly 185,000 employees, including more than 145,000 in Europe. The Group has key positions in its three main fields of activity: Commercial, Personal Banking & Services for the Group’s commercial & personal banking and several specialized businesses including BNP Paribas Personal Finance and Arval; Investment & Protection Services for savings, investment, and protection solutions; and Corporate & Institutional Banking, focused on corporate and institutional clients. Based on its strong diversified and integrated model, the Group helps all its clients (individuals, community associations, entrepreneurs, SMEs, corporates and institutional clients) to realize their projects through solutions spanning financing, investment, savings and protection insurance. In Europe, BNP Paribas has four domestic markets: Belgium, France, Italy, and Luxembourg. The Group is rolling out its integrated commercial & personal banking model across several Mediterranean countries, Turkey, and Eastern Europe. As a key player in international banking, the Group has leading platforms and business lines in Europe, a strong presence in the Americas as well as a solid and fast-growing business in Asia-Pacific. BNP Paribas has implemented a Corporate Social Responsibility approach in all its activities, enabling it to contribute to the construction of a sustainable future, while ensuring the Group's performance and stability. About BNP Paribas India Solutions: Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions. Commitment to Diversity and Inclusion At BNP Paribas, we passionately embrace diversity and are committed to fostering an inclusive workplace where all employees are valued, respected and can bring their authentic selves to work. We prohibit Discrimination and Harassment of any kind and our policies promote equal employment opportunity for all employees and applicants, irrespective of, but not limited to their gender, gender identity, sex, sexual orientation, ethnicity, race, colour, national origin, age, religion, social status, mental or physical disabilities, veteran status etc. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in.