Senior Data Engineer
- Hyderabad
- Analytics
- Permanent
- Hybrid
- Full Time
- Senior Data Engineer is responsible for design, develop and support ETL data pipelines solutions primary in AWS environment
- Design, develop, and maintain scaled ETL process to deliver meaningful insights from large and complicated data sets.
- Work as part of a team to build out and support data warehouse, implement solutions using PySpark to process structured and unstructured data.
- Play key role in building out a semantic layer through development of ETLs and virtualized views.
- Collaborate with Engineering teams to discovery and leverage new data being introduced into the environment
- Support existing ETL processes written in SQL, or leveraging third party APIs with Python, troubleshoot and resolve production issues.
- Strong SQL and data to understand and troubleshoot existing complex SQL.
- Hands-on experience with Apache Airflow or equivalent tools (AWS MWAA) for orchestration of data pipelines
- Create and maintain report specifications and process documentations as part of the required data deliverables.
- Serve as liaison with business and technical teams to achieve project objectives, delivering cross functional reporting solutions.
- Troubleshoot and resolve data, system, and performance issues
- Communicating with business partners, other technical teams and management to collect requirements, articulate data deliverables, and provide technical designs.
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.
We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.
We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.
- you have completed graduation from BE/Btech
- 6 to 9 years of experience in Data Engineering development
- 5 years of experience in Python scripting
- You should have 8 years experience in SQL, 5+years in Datawarehouse, 5yrs in Agile and 3yrs with Cloud
- 3 years of experience with AWS ecosystem (Redshift, EMR, S3, MWAA)
- 5 years of experience in Agile development methodology
- You will work with the team to create solutions
- Proficiency in CI/CD tools (Jenkins, GitLab, etc.)
Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
#LI-Onsite
Benefits
Experian care for employee's work life balance, health, safety and wellbeing.
1) In support of this endeavor, we offer the best family well-being benefits,
2) Enhanced medical benefits and paid time off.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Explore Experian's award winning 'people first' culture.
Being part of Experian is exciting. Every day brings new challenges, new opportunities, new ways for us to do what we do best: using our innovative technologies and data to work in new and surprising ways. All brought together in a single thought: Discover the Unexpected.
Learn moreRecommended Jobs
Salary
Location
Kuala Lumpur, Malaysia
Experience Level
Not Applicable
Employment
Permanent
Location
Kuala Lumpur
Role Type
Hybrid
Schedule
Full Time
Department
Product Development
Brand
Experian
Remote working available
No
Description
Job description What you'll need to bring to the party Successful candidates will play a major part in SDLC and providing support to internal system users.Be a highly respected member of the team capa
Reference
deea43e3-2041-42ae-a928-e53d234c56cb
Expiry Date
01/01/0001
Salary
Location
North Sydney, Australia
Experience Level
Mid-Senior Level
Employment
Permanent
Location
Sydney
Role Type
Hybrid
Schedule
Full Time
Department
Sales & Business Development
Brand
Experian
Remote working available
No
Description
Our Customer Success team play an integral part in maintaining and growing our clients across ANZ. They advise and guide a wide variety of clients who are using Experian products, from the point of s
Reference
8ea305f7-a719-4e9b-8da1-4a29a4746f66
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Administration & Office Support
Brand
Serasa Experian
Remote working available
No
Description
Estamos em busca de um(a) Analista de Gestão de Custos e Receitas para integrar nossa equipe e garantir o controle eficiente dos custos e receitas da nossa área BU Agribusiness. O profissional será re
Reference
3087edc0-b474-48e5-b336-653d90d22437
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Entry Level
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Customer Service
Brand
Serasa Experian
Remote working available
No
Description
Quais serão suas principais entregas?Atuar em equipes multidisciplinares durante todo o ciclo de vida dos projetos (análise de requisitos desenho da solução, desenvolvimento, testes/certificação, impl
Reference
f98eefe7-25ab-466e-bb52-99aaf0668125
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Home
Schedule
Full Time
Department
Product Development
Brand
Serasa Experian
Remote working available
No
Description
Quais serão suas principais entregas? Projetar, desenvolver e manter aplicações e micros serviços do lado do servidor usando Node.js e TypeScript;Escrever código limpo, manutenível e eficiente, seguin
Reference
e2c9cffa-a4cf-49c3-bc5c-c0b829796d6d
Expiry Date
01/01/0001
Salary
Location
Nottingham, England
Experience Level
Mid-Senior Level
Employment
Permanent
Location
Nottingham
Role Type
Hybrid
Schedule
Full Time
Department
Product Management
Brand
Experian
Remote working available
No
Description
We're looking for a great Senior Product Manager to join the Ecosystem team in ECS and help continue innovating and creating a first-class ecosystem.You'll report to the Head of Product and you will i
Reference
46ea3084-c3d4-405d-b32d-dbcfdf954fac
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Home
Schedule
Full Time
Department
Product Development
Brand
Serasa Experian
Remote working available
Yes
Description
Você será responsável por:Projetar, desenvolver e manter aplicações e microsserviços usando Java - Spring Boot;Escrever código limpo, manutenível e eficiente, seguindo as melhores práticas e padrões d
Reference
f60671bc-0b99-4f3d-8b3e-51eb569111b5
Expiry Date
01/01/0001
Salary
Location
São Carlos, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Carlo
Role Type
Home
Schedule
Full Time
Department
Product Management
Brand
Serasa Experian
Remote working available
No
Description
Estamos em busca de um Product Owner (PO) Sênior em Finanças. A pessoa ideal devera possuir experiência prévia na função e será responsável por liderar o desenvolvimento de produtos financeiros para a
Reference
563d0383-b24a-4100-afcc-806d38a6e929
Expiry Date
01/01/0001
Salary
Location
United States
Experience Level
Mid-Senior Level
Employment
Permanent
Location
United States
Role Type
Home
Salary Range
See Pay Range
Schedule
Full Time
Department
Sales & Business Development
Brand
Experian
Remote working available
Yes
Description
At Experian Health, our employees can shape more than products – they shape the future of U.S. healthcare. Experian Health is a pioneer for innovations leading the way in revenue cycle management, ide
Reference
f755b86b-5d23-4b33-a2f9-668ab4295df8
Expiry Date
01/01/0001
Salary
Location
Heredia , Costa Rica
Experience Level
Not Applicable
Employment
Permanent
Location
Heredia
Role Type
Hybrid
Schedule
Full Time
Department
Customer Service
Brand
Experian
Remote working available
Yes
Description
Experian Automotive is searching for a call center representative who will be an important contributor to the Client Services team.You will be a resource for the Call Center, providing support to Auto
Reference
ebfb5a38-1cbf-4d3d-b965-d9f7dc1afd40
Expiry Date
01/01/0001
Salary
Location
Heredia , Costa Rica
Experience Level
Not Applicable
Employment
Permanent
Location
Heredia
Role Type
Hybrid
Schedule
Full Time
Department
Product Development
Brand
Experian
Remote working available
Yes
Description
Designs, codes, tests, corrects, and documents simple programs, or scripts and assists in the implementation of software which forms part of a properly engineered information or communications system
Reference
1224264d-d70f-4de5-8fe1-ce3e9d1052ba
Expiry Date
01/01/0001
Salary
Location
Hyderabad, India
Experience Level
Not Applicable
Employment
Permanent
Location
Hyderabad
Role Type
Hybrid
Schedule
Full Time
Department
Information Technology & Systems
Brand
Experian
Remote working available
No
Description
The Senior Cloud Network Engineer is a hands-on technical position responsible for operating a diverse set of cloud security controls and monitoring processes. You will work directly with security arc
Reference
c3ef9047-52a8-4de3-adbd-616171c86d15
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Project Management
Brand
Serasa Experian
Remote working available
No
Description
Responsável pelo acompanhamento e desenvolvimento de novos projetos, incluindo a coleta de dados, pesquisa e análise das informações. Avaliar e apresentar novas ideias para melhorar os processos atuai
Reference
a284b122-f6fa-495c-8c13-2dc61b4a2ff1
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Product Management
Brand
Serasa Experian
Remote working available
No
Description
Venha transformar o agronegócio com inovação e eficiência como Analista de Produtos Pleno!
Reference
5ee9889b-bad2-45d4-8612-a349db3c7a39
Expiry Date
01/01/0001
Salary
Location
São Paulo, Brazil
Experience Level
Not Applicable
Employment
Permanent
Location
Sao Paulo
Role Type
Hybrid
Schedule
Full Time
Department
Analytics
Brand
Serasa Experian
Remote working available
No
Description
Estamos procurando um Analista Cientista de Dados Sênior para se juntar à nossa equipe.O candidato (a) ideal terá experiência significativa em análise de dados, modelagem estatística e machine learnin
Reference
8a4808d5-b504-4af4-9779-eb616f7cf12c
Expiry Date
01/01/0001
Salary
Location
Southbank, Australia
Experience Level
Not Applicable
Employment
Permanent
Location
Southbank
Role Type
Hybrid
Schedule
Full Time
Department
Product Management
Brand
Experian
Remote working available
No
Description
This role is necessary to our product's success by ensuring that our messaging is both compelling and consistent across all channels. You will support the Head of Product Success by blending industry-
Reference
952d69a7-83d5-494c-b0d4-06272071b4e7
Expiry Date
01/01/0001