Edmund Esparas
Data Engineer
Tokyo,11
Summary
A dedicated data engineer with hands-on experience utilizing Databricks for data processing and analytics. My expertise includes designing and implementing robust data pipelines, optimizing data workflows, and ensuring the reliability and scalability of data infrastructure. I possess strong skills in SQL, Python, and Spark, and have a proven track record of improving data operations and delivering actionable insights. With excellent problem-solving abilities and a keen eye for detail, I am adept at both independent and collaborative work environments. My strong communication skills enable effective collaboration with cross-functional teams to drive data-driven decision-making
Overview
20
20
years of professional experience
5
5
years of post-secondary education
2
2
Certifications
Work History
Data Engineer
Rakuten
Tokyo, Japan, 13
9 2021 - Current
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks
- Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors
- Streamlined complex workflows by breaking them down into manageable components for easier implementation and maintenance
- Monitoring and troubleshooting data pipelines
- Responsible for monitoring and troubleshooting data pipelines to ensure they are running smoothly and efficiently.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability
- .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting
Reporting Manager/Developer
Full Potential Solutions
Pasig, Philippines
10.2018 - 12.2020
- Develop system and standard for business reports
- Involved in requirement analysis, design, coding and implementation
- Processed data into HDFS by developing solutions, analyzed the data using Map Reduce, Pig, Hive and Produce summary results from Hadoop that will be used by Periscope Data
- Used Sqoop to import the data from Hadoop Distributed File System (HDFS) to RDBMS
- Loading Transforming set of structured, Semi-structured and unstructured data and analyzed then by running hive queries and pig scripts
- Design and develop reports in Periscope Data
- Perform data extraction, builds recurring and ad-hoc reports and analysis; designs, develops and implement customized tables, queries and reports; gather information about reporting needs, objective, functions, features and input/output requirements
- Create VBA tools to automatically update Excel workbooks, encompassing class and program modules and external data queries used for client reporting.
Technical Lead/ETL Developer
Teradata GDC Manila, IT Consulting
6 2012 - 10.2018
- Provide technical and leadership support in project planning, business requirement validation, data model design/mapping, and ETL to align with development and testing phases
- Collaborated with the Project Manager to oversee developers and manage tasks across development, SIT, UAT, production roll-out support, handover, and warranty periods
- Served as the first reviewer and QA for deliverables in all project phases
- Analyzed risks and escalated technical issues to the Project Manager, assisting in providing technical alternatives and decisions
- Reviewed test scope, approach, and strategies
- Coordinate with the infrastructure team on non-production and production environments
- Ensured adherence to Teradata best practices, making technical decisions and setting development and testing standards
- Experienced in ETL development, including importing/exporting data using Sqoop between HDFS and relational databases
- Hands-on experience with Hadoop ecosystem components (MapReduce, HDFS, HBase, Hive, Sqoop, Pig, Zookeeper)
- Contributed to the development of the Migration COE Teradata DDL Converter Tool using Excel Macro/VBA, automating the conversion of Oracle table definitions to Teradata DDLs and saving significant man-hours
Oracle Developer
Sumisho Motor Finance Corporation
1 2008 - 1 2012
- Participated in SDLC phases: requirements gathering, design, development, testing
- Developed Oracle Forms and Reports (Oracle 6i, 10g, OAS)
- Conducted ETL development using Informatica Power Center 9 ·
- Created PL/SQL packages, procedures, and functions for Oracle 10g
- Performed system performance tuning by optimizing queries and code
- Documented technical specifications for database designs
- Managed projects by assessing requirements, recommending solutions, and delivering applications on schedule
- Ensure application quality and compliance with SMF standards, including testing, QA, and data migration
- Regularly reviewed and upgraded existing applications, ensuring system availability and minimal downtime ·
- Maintained compliance with audit recommendations and ensured information accessibility
Senior Computer Programmer
Arabian Pipes Company
08.2008 - 12.2010
- Worked on the SDLC, including requirements gathering, design, construction, unit, and system testing
- Developed forms and reports (Oracle 6i, Oracle 10g Forms and Reports) based on specifications
- Migrated Power Builder 5 system applications (Inventory, Production, Purchasing, Delivery) to Oracle 10g Forms and Reports
- Upgraded Oracle 8i database to Oracle 10g
- Performed system performance tuning by optimizing queries and code
- Prepared coding schemes for data maintenance and processing
- Developed logical record structures and identified file access requirements
- Conducted comprehensive user training programs before implementing new or modified systems
- Executed basic Oracle DBA tasks
System Developer
International Wiring System Philippines
04.2004 - 08.2008
- Developed database triggers and stored procedures using PL/SQL cursors, bulk binding and bulk fetching, arrays, records and temporary tables called by Visual Basic Form to perform specific computations and processes (MSSQL Server 2000, Oracle 10g)
- Designed Systems that can generate reports about the total production of assembly lines that have been praised by management and QA Staffs because of its flexibility and reliability
- The systems used Visual Basic 6.0, Oracle 9i and MS SQL 2000 Database and SEAGATE Crystal Report as language, database and report (VB6, Crystal Report, MSSQL Server 2000, OMRON and KEYENCE PLC)
- Create new applications based on additional requirements and specifications
- Control System design, development, testing and implementation to all users
- Design the most efficient system and prepares the system specification necessary for development
- Ensures that the system modification is authorized and based on schedule
- Defines system and user requirements, inputs and outputs
- Grant access to users based on system rights
- Prepares comparative analysis of the existing system and the proposed system
- Coordinates with system users regarding system related issues Develops systems in accordance to system specifications and user requirements
- Deploys the latest system version to all system users
- Prepares the system and users for formal cut off the new system
- Prepares/Update computer operation instruction for new modified systems
- Prepares Computer operation manual
Education
B.S - Computer Engineering
AMA Computer College
Tarlac City 06.1999 - 03.2004
Skills
Databricks, Python, Pyspark
Teradata, MySQL, Oracle, MS SQL Server, DB2, Sybase, Postgre SQL
Informatica, SAP BODS, Talend, Oracle Warehouse Builder, SSIS, Data Stage
Oracle Forms and Reports
Shell/Bash Scripting
VB6, VBA, Power Builder
Presto/Trino, Toad, Oracle Developer
Tableau, Periscope
Consulting
Analytical
Project Management
Accomplishments
- Teradata Consulting Excellence Award 2016 (02/2017)
- Night of Town Award: Live Nation MS SQL/SAP Data Services Migration (08/2017)
- Night of Town Award: T-Mobile, USA EDW Project (10/2016)
- Employee of the Quarter: Banner Health Project (12/2015)
- Team of the Quarter: Banner Health Project (12/2015)
- Employee of the Quarter: Roger’s roadmap Project (12/2014)
- Team of the Quarter: Roger’s roadmap Project (12/2014)
- Team of the Quarter: Flextronics (12/2013)
Certification
Databricks Certified Data Engineer Associate (https://credentials.databricks.com/9d0e65d3-ad7a-47a8-be3b-2ee59cc559da)
Timeline
Databricks Certified Data Engineer Associate (https://credentials.databricks.com/9d0e65d3-ad7a-47a8-be3b-2ee59cc559da)
06-2024
Reporting Manager/Developer
Full Potential Solutions
10.2018 - 12.2020
Teradata 12 Certified Professional (https://www.youracclaim.com/badges/b80ea5fc-ba80-4d42-9a81-399c008d523a/linked_in_profile)
02-2014
Senior Computer Programmer
Arabian Pipes Company
08.2008 - 12.2010
System Developer
International Wiring System Philippines
04.2004 - 08.2008
B.S - Computer Engineering
AMA Computer College
06.1999 - 03.2004
Data Engineer
Rakuten
9 2021 - Current
Technical Lead/ETL Developer
Teradata GDC Manila, IT Consulting
6 2012 - 10.2018
Oracle Developer
Sumisho Motor Finance Corporation
1 2008 - 1 2012
Similar Profiles
Jeevan DJeevan D
Software Engineer - DevOps at RakutenSoftware Engineer - DevOps at Rakuten
Kirtish TrivediKirtish Trivedi
Team Lead at RakutenTeam Lead at Rakuten
Syyam NoorSyyam Noor
Mobile Engineer at RakutenMobile Engineer at Rakuten