Y V Pawan Kumar
Engineering Manager - Data & Analytics
Yokohama, India,Relocating To Hyderabad,
Summary
11 years of industry experience and 8 years of relevant experience in Managing, Mentoring and Leading team of Data Engineers, ML Engineers and Data Analysts. Expertise in leading analytical and engineering application projects for technology industries. Successfully built technology portfolios in building Data & Analytics solutions. Experience in authoring end-to-end data analytics for Voice assistant and Quality based products. An innovative mindset in finding opportunities of improvement by bringing in new cutting edge data technologies to the team and the business. Skilled in ramping up to subject matter expert of the domain associated to and lead the conversations with the stake holders. Mentored teams towards personal and professional success by actively interacting and curating healthy challenges. A tech-enthusiast with the continuous interest in self-learning and development keeping in sync with the data technolgies.
Overview
12
12
years of professional experience
4
4
years of post-secondary education
Work History
Engineering Manager, Data Analytics
Cognizant Technology Services
Hyderabad, Telangana
2017.09 - Current
- Played a key role in building scalable and optimized ETL pipelines in building data warehouse and data marts for analytical purposes
- Effectively and productively managed team of Data Engineers, ML Engineering and Data Analysts
- Very strong hands-on experience in requirement gathering and communication and delivery planning with the stake holders
- Responsible for continuously looking for opportunities to optimize engineering pipelines and improve delivery latencies
- Designed and implemented ML pipelines in the productions managing Model lifecycle with effectively monitoring performances
- Built systems to monitor the data, model & feature drifts to measure the impact of production ML models
- Developed complex SQL queries to analyze data from the desperate sources and the types
- Programmed to deploy scalable Batch & Streaming data pipelines on Big Data clusters using Spark, Python, Kafka, Airflow & Teamcity
- Modeled data warehouses on Hive, PostgreSQL and MongoDB managing huge volumes of in flow
- Exploration of new technologies and execute proof of concepts for the fitment and cost analysis
- Designed KPI's to measure Models, Systems and Operational performances on the Tableau dashboards
- Managed scripted API services on AWS EC2 with the underlying AWS S3 data lake architectures
- Team and task management through JIRA following Agile methodologies
- Strong experience in unblocking team from the technical standpoint in the process of designing and implementing solutions
- Deployed containerized Data Models using Kubernetes, Dockers and implementing CI/CD infrastructure services
- Author, collaborate and version controlling through GitHub and other similar tools
- Hands on experience in applying Linear Regressions, Logistic Regressions, Decision Trees, Clustering models on medium to huge datasets
Senior BI Engineer
Sowra Info Solutions Pvt Ltd
Hyderabad, India
2015.06 - 2017.09
- Effectively communicating insights and plans to cross-functional teams helping them to meet targets
- Managed team of Data Engineers with the task management and planning deliveries
- Built data workflows & pipelines using Big Data technologies Apache Spark, Kafka, Hive, Impala, Airflow & Jenkins
- Built robust & high-performance API platform for down streams using Flask & ELK stack
- Hands-on experience in using Hue, Zeeplin, DBeaver, DataGrip and other similar data accessing tools
- Implemented scalable solutions to meet the ever-increasing data volumes. Designed a Data Staging architecture for developing Fault tolerant data platforms
- Experience in complete Model Software Development Life Cycle (Develop -> Test -> Deploy -> Maintain -> Enhance) following Agile methodologies
- Integrated Tableau with Python/R scripts through Web Data Connectors to visualize the patterns or outcomes of Machine Learning Models
- Built complex dashboards and automated maintenance on tableau servers for daily operational insights like Throughput, Productivity, Turn Around Time, Quality, Time to Market, Outlier detections, Capacity Monitoring & Planning
- Installing, Configuring EC2 On-Demand, Reserved Instances (Linux) on AWS Cloud
- Planning and decision makings on server configurations to reduce cloud costs for the product
- Developed Dockerfile(S), Docker images, managed AWS ECS repository, deployed and maintained container images on AWS – ECS( EC2 Container as a Service) for better scalability, availability and to minimize deployment time
- Configured Load Balancers on AWS to redirect traffic to respective containers based on REST services
- Application, Images and Database backups automation to AWS – S3
Senior Data Consultant
CDK Global India
Hyderabad, India
2013.09 - 2015.06
- Managed and mentored Oracle DBA professionals, part of automation team to schedule daily DBA jobs and reduce resource costing to the project
- Responsible for administering, planning and maintaining large scale database environments
- Implemented data restorations and migration activities using Oracle utilities across the UNIX servers
- Built highly scalable and highly available database environments to keep the downtime to near zero for the mission critical applications
- Developed PL/SQL packages, procedures, functions and triggers for automated jobs and scheduled maintenance activities
- Programmed the backups and recoveries efficiently
- Setup Disaster Recovery environments and perform DR switches through the maintenance windows
- Automated the regular maintenance tasks through developing SHELL scripting based tools
- Reduced the human interventions in the DBA activities by 45% in the span of an year with advanced handy tools
- Supported analytics team to acquire data, polishing for predicting next possible dates of infrastructure resource unavailability’s
- Implemented best practices and standards to meet the SLAs and for service quality improvement
- Developed a basic regression algorithm(s) for predicting space for databases that would be required for the databases to plan storage for next couple of years based on the past allocation history
Senior Oracle DBA
HCL Infosystems
Chennai, India
2010.08 - 2013.09
- Key team player with Oracle DBA skills in maintaining and managing huge databases
- Part of day to day administration activities and planning maintenance windows
- Analyse data volumes and growth to stratify the space allocations more efficiently across environments
- Moved to intermediate level engineer soon to take care of single instance environments from installation phase to scheduling maintenance phases
- Moved to the expert’s team to help multiple projects automate their DBA activities and create a project planning for maintenance for RAC, DR environments
Education
Bachelor of Science - Electronics & Communication Engineering
Jawaharlal Nehru Technological University
Hyderabad, India 2006.08 - 2010.05
Post Graduation - Big Data Analytics
INSOFE (Carnegie Melon University)
Hyderabad, India 2016.03 - 2016.10
Skills
Team Management
Big Data
Spark
Data Analysis
Data & ML Pipelines
ETL
Visualizations
SQL
Python
Hive
AWS
Machine Learning
Data warehouse
Docker
Kubernetes
Tableau
NoSQL
RDBMS
Timeline
Engineering Manager, Data Analytics
Cognizant Technology Services
2017.09 - Current
Post Graduation - Big Data Analytics
INSOFE (Carnegie Melon University)
2016.03 - 2016.10
Senior BI Engineer
Sowra Info Solutions Pvt Ltd
2015.06 - 2017.09
Senior Data Consultant
CDK Global India
2013.09 - 2015.06
Senior Oracle DBA
HCL Infosystems
2010.08 - 2013.09
Bachelor of Science - Electronics & Communication Engineering
Jawaharlal Nehru Technological University
2006.08 - 2010.05