Niketa Gorajanal
Lead Data Engineer
Bangalore
Summary
Innovative Lead Data Engineer with extensive experience at Rakuten India, specializing in building robust data architectures and enhancing data quality. Proficient in Big Data technologies like Spark and GCP, I excel in orchestrating ETL processes and automating workflows. Strong problem-solving skills drive my success in delivering high-impact data solutions.
Overview
11
11
years of professional experience
Work History
Lead Data Engineer
Rakuten India
Bangalore, Karnataka
08.2022 - Current
- Leading the design and development of Rakuten's Customer DNA Data Warehouse using ETL processes to integrate data from various sources, ensuring high data quality and availability for downstream users.
- Architected and built a robust Data Lake using GCP services such as BigLake, BigQuery, and Google Cloud Storage (GCS), enabling efficient storage, processing, and analysis of large-scale data.
- Played a key role in the productionization of ML pipelines, enhancing the flow of data for machine learning models.
- Proficient in Airflow for orchestrating and automating workflows, ensuring smooth data pipeline operations and timely execution of tasks.
- Oversaw real-time data processing using Apache Spark and other cloud-native tools, ensuring low-latency data processing and analytics.
- Traveled to Japan in April 2024 for project requirements gathering and understanding the business needs to enhance data engineering solutions.
Senior Software Engineer
Legato Healthcare
08.2020 - 06.2022
- Migrated and optimized big data platforms to AWS, supporting fraud detection and claims anomaly identification processes.
- Developed Spark jobs using Python and Scala for batch data processing and real-time analytics.
- Automated ETL processes by migrating on-premises jobs to AWS Glue, orchestrating workflows with Step Functions and Lambda for smooth data operations.
Senior Software Developer
Mindtree Ltd
07.2018 - 06.2020
- Led the migration of legacy systems to AWS, implementing real-time data streaming using Apache Spark, Nifi, and Kafka.
- Developed scalable Spark jobs in Scala for data processing and integration, ensuring reliable data flows to cloud data stores like PostgreSQL.
- Implemented rigorous unit testing strategies for Spark jobs to ensure high reliability and data quality.
Software Engineer
Hewlett Packard Enterprise
09.2014 - 06.2018
- Contributed to the development of telecom applications on HPE OCCP, improving system performance and application lifecycle management.
- Delivered training to Turkcell developers in Turkey, providing in-depth support for application development and troubleshooting.
- Developed user interfaces and backend services for smart home and streetlight illumination applications.
Education
Bachelor of Engineering in Computer Science
B.V. Bhoomreddy College of Engineering, Hubli
06-2014
Skills
Big Data Technologies: Spark, Hadoop, Kafka
Programming Languages: Python,
SQL Data Technologies: Hive, MySQL
Engineering & ML: Data Lake, ETL, Data Pipeline Production, Airflow Orchestration & Automation: Airflow, AWS Step Functions, Lambda
Timeline
Lead Data Engineer
Rakuten India
08.2022 - Current
Senior Software Engineer
Legato Healthcare
08.2020 - 06.2022
Senior Software Developer
Mindtree Ltd
07.2018 - 06.2020
Software Engineer
Hewlett Packard Enterprise
09.2014 - 06.2018
Bachelor of Engineering in Computer Science
B.V. Bhoomreddy College of Engineering, Hubli
Similar Profiles
Shantanu KumarShantanu Kumar
Software Developer at Rakuten IndiaSoftware Developer at Rakuten India
Vishnu ChaturvediVishnu Chaturvedi
Software Engineer II at Rakuten IndiaSoftware Engineer II at Rakuten India
Punith KumarPunith Kumar
Senior Software Engineer at Rakuten IndiaSenior Software Engineer at Rakuten India