Senior Data Engineer
- Hyderabad
- Analytics
- Permanent
- Hybrid
- Full Time
- Senior Data Engineer is responsible for design, develop and support ETL data pipelines solutions primary in AWS environment
- Design, develop, and maintain scaled ETL process to deliver meaningful insights from large and complicated data sets.
- Work as part of a team to build out and support data warehouse, implement solutions using PySpark to process structured and unstructured data.
- Play key role in building out a semantic layer through development of ETLs and virtualized views.
- Collaborate with Engineering teams to discovery and leverage new data being introduced into the environment
- Support existing ETL processes written in SQL, or leveraging third party APIs with Python, troubleshoot and resolve production issues.
- Strong SQL and data to understand and troubleshoot existing complex SQL.
- Hands-on experience with Apache Airflow or equivalent tools (AWS MWAA) for orchestration of data pipelines
- Create and maintain report specifications and process documentations as part of the required data deliverables.
- Serve as liaison with business and technical teams to achieve project objectives, delivering cross functional reporting solutions.
- Troubleshoot and resolve data, system, and performance issues
- Communicating with business partners, other technical teams and management to collect requirements, articulate data deliverables, and provide technical designs.
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.
We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.
We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.
- you have completed graduation from BE/Btech
- 6 to 9 years of experience in Data Engineering development
- 5 years of experience in Python scripting
- You should have 8 years experience in SQL, 5+years in Datawarehouse, 5yrs in Agile and 3yrs with Cloud
- 3 years of experience with AWS ecosystem (Redshift, EMR, S3, MWAA)
- 5 years of experience in Agile development methodology
- You will work with the team to create solutions
- Proficiency in CI/CD tools (Jenkins, GitLab, etc.)
Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
#LI-Onsite
Benefits
Experian care for employee's work life balance, health, safety and wellbeing.
1) In support of this endeavor, we offer the best family well-being benefits,
2) Enhanced medical benefits and paid time off.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Explore Experian's award winning 'people first' culture.
Being part of Experian is exciting. Every day brings new challenges, new opportunities, new ways for us to do what we do best: using our innovative technologies and data to work in new and surprising ways. All brought together in a single thought: Discover the Unexpected.
Learn moreRecommended Jobs
Salary
Location
Hyderabad, India
Experience Level
Not Applicable
Employment
Permanent
Location
Hyderabad
Role Type
Hybrid
Schedule
Full Time
Department
Project Management
Brand
Experian
Remote working available
No
Description
Job description Experian Direct to Consumer Line of Business is seeking a motivated and detail-oriented Technical Program Manager (TPM) to join our Software Delivery Organization. This role supports t
Reference
39999ce9-9b5f-41cd-9220-22ea9ef56304
Expiry Date
01/01/0001
Salary
Location
Mumbai, India
Experience Level
Associate
Employment
Permanent
Location
Mumbai
Role Type
Hybrid
Schedule
Full Time
Department
Information Technology & Systems
Brand
Experian
Remote working available
No
Description
Experian India is looking for an Information Security Manager What you’ll be doing (Job responsibilities for this role)Regulatory Compliance & GovernanceEnsure adherence to Reserve Bank of India (RBI)
Reference
08108463-fe86-4750-b285-9095479aeb74
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Legal & Compliance
Brand
Serasa Experian
Remote working available
No
Description
Quais serão suas principais entregas?Estruturar os contratos para as soluções da Companhia;Dar suporte à área comercial, participando da negociação de contratos, em português ou inglês;Dar suporte às
Reference
a1203c6c-1b42-40d3-857b-543dd4ac1231
Expiry Date
01/01/0001
Salary
Location
Sofia , Bulgaria
Experience Level
Internship
Employment
Intern
Location
Sofia
Role Type
Hybrid
Schedule
Full Time
Department
Finance
Brand
Experian
Remote working available
No
Description
We are looking for a Finance Intern to join our dynamic team and gain hands-on experience in financial reporting. This is a full-time position on a 12-month contract reporting to the Finance Manager.W
Reference
10464a47-efd8-449c-ba6d-a0eacff831a8
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Data Management
Brand
Serasa Experian
Remote working available
No
Description
Atuar em times multidisciplinares de dados contribuindo desde o mapeamento de requisitos, até a modelagem e disponibilização dos dados.Traduzir as necessidades de negócios em soluções alinhadas com as
Reference
1a4c676d-0b54-4576-8612-dac165256e06
Expiry Date
01/01/0001
Salary
Location
Costa Mesa, United States
Experience Level
Mid-Senior Level
Employment
Permanent
Location
Costa Mesa
Role Type
Home
Salary Range
$100,649 - $174,459
Schedule
Full Time
Department
Product Development
Brand
Experian
Remote working available
No
Description
We are looking for a Senior Software Engineer specializing in Retrieval-Augmented Generation (RAG) systems, with experience in large language models (LLMs), vector databases, and cloud-based microserv
Reference
3a380cf1-85e8-4efc-9f9a-ccdf54448428
Expiry Date
01/01/0001
Salary
Location
Hyderabad, India
Experience Level
Not Applicable
Employment
Permanent
Location
Hyderabad
Role Type
Hybrid
Schedule
Full Time
Department
Product Development
Brand
Experian
Remote working available
No
Description
Job description Job DescriptionExperian UK&I Business information division is looking for an accomplished Senior Data Engineer to join our dynamic team. You will develop data engineering applications
Reference
f9bfb9d3-161f-437f-9868-100395c7471a
Expiry Date
01/01/0001
Salary
Location
London, England
Experience Level
Not Applicable
Employment
Permanent
Location
London
Role Type
Hybrid
Schedule
Full Time
Department
Sales & Business Development
Brand
Experian
Remote working available
No
Description
We are looking for a Business Development Manager to join the Experian Identity Verification & Fraud team, working within our Go-to-Market function and alongside our vertical account management teams,
Reference
dba4a58a-5e46-498d-8aee-37bb5c62408f
Expiry Date
01/01/0001
Salary
Location
London, England
Experience Level
Not Applicable
Employment
Permanent
Location
London
Role Type
Hybrid
Schedule
Full Time
Department
Analytics
Brand
Experian
Remote working available
No
Description
The Generative AI Centre of Expertise (GenAI CoE) at Experian exists to improve our products, our internal processes and our daily work through GenAI and process automation. The team is a mix of ML en
Reference
a5ecd6ec-ab5c-449a-ab4b-8aa331359bcf
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Home
Schedule
Full Time
Department
Product Development
Brand
Serasa Experian
Remote working available
No
Description
Quais serão suas principais responsabilidades:Estruturar e conduzir descobertas e pesquisas para entender as necessidades dos usuários, mapeando jornadas, necessidades e pontos de dor;Criar jornadas e
Reference
5646a2d7-37f8-487f-90e6-ba937927bb90
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Roam
Schedule
Full Time
Department
Sales & Business Development
Brand
Serasa Experian
Remote working available
No
Description
Realizar Vendas e Atendimento de sua carteira de Clientes do Segmento da INDUSTRIA no estado de São Paulo;Conhecer profundamente o Segmento que seus clientes estão inseridos e a atuação dos mesmos;Ela
Reference
ec67e968-af8d-405a-82c1-2a5a524a4b48
Expiry Date
01/01/0001
Salary
Location
Nottingham, England
Experience Level
Not Applicable
Employment
Permanent
Location
Nottingham
Role Type
Hybrid
Schedule
Full Time
Department
Finance
Brand
Experian
Remote working available
No
Description
We’re hiring for a pivotal role in the Procurement team, offering a fantastic opportunity to shape the future of procurement across the region.As the Technology Buying Group Lead, you’ll oversee all t
Reference
293ab53a-c2a3-44b6-83b3-daae1ef5895d
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Customer Service
Brand
Serasa Experian
Remote working available
No
Description
Quais serão suas principais responsabilidades?Nesta posição você se tornará parte integrante de nossa equipe de Customer Experience com foco no sucesso do cliente no uso das nossas soluções de prevenç
Reference
c232cbc3-0908-412d-8e13-5a589ea526c5
Expiry Date
01/01/0001
Salary
Location
Hyderabad, India
Experience Level
Not Applicable
Employment
Permanent
Location
Hyderabad
Role Type
Hybrid
Schedule
Full Time
Department
Product Management
Brand
Experian
Remote working available
No
Description
Experian's direct-to-consumer (D2C) team is seeking Product Manager to own membership communication and digital support experience and strategy. This includes critical infrastructure that underpins tr
Reference
a5dfbb8c-68f4-4dfe-8cf3-507d7caa6c48
Expiry Date
01/01/0001
Salary
Location
Sofia , Bulgaria
Experience Level
Not Applicable
Employment
Permanent
Location
Sofia
Role Type
Hybrid
Schedule
Full Time
Department
Analytics
Brand
Experian
Remote working available
No
Description
What you will do:Assist in monitoring and running daily ETL/ELT pipelines using SQL and cloud tools (e.g., AWS, SQL Server, Athena)Help troubleshoot data pipeline issues (e.g., job errors, missing dat
Reference
e468625c-382a-488d-b7f0-30b6f6e4a779
Expiry Date
01/01/0001
Salary
Location
Nottingham, England
Experience Level
Not Applicable
Employment
Permanent
Location
Nottingham
Role Type
Hybrid
Schedule
Full Time
Department
Legal & Compliance
Brand
Experian
Remote working available
No
Description
Why this role is important to usOperational Risk is central to how we protect our business, our people, and our customers. You will sit within our Group Risk team and play a part in shaping the strate
Reference
5f47d36a-de3d-4e0d-b40a-d3a8d6897d04
Expiry Date
01/01/0001