With 15 years of IT experience and 6 years dedicated to data engineering, I specialize in building scalable, high-performance data pipelines and analytics solutions on Microsoft Azure. I help businesses in Insurance, Retail, and Banking transform raw data into actionable insights by designing and implementing end-to-end ETL/ELT workflows using Azure Synapse Analytics, Azure Data Factory, Databricks, and Power BI.
My expertise includes:
Real-time and batch data pipeline development with PySpark and Delta Lake
Streaming data processing using Spark Structured Streaming and Azure Event Hubs
Automated CI/CD pipelines with Azure DevOps for reliable deployments
Data governance, quality enforcement, and secure data access with Unity Catalog
Integration of diverse data sources using Informatica PowerCenter and SQL
Iโm proficient in Python, SQL, Apache Airflow, and cloud platforms like Azure and AWS. I hold certifications as an Azure Data Engineer (DP-203), AWS Solutions Architect Associate, and Informatica Developer.
If you need a dependable freelance data engineer to deliver robust, scalable, and cost-efficient cloud data solutions, letโs connect!
๐ Nationality | ๐ฎ๐ณ India |
๐ก Residency | ๐ฎ๐ณ India |
๐ Location | ๐ณ๐ฑ Netherlands |
![]() |
rok.co/@pkishoreroy |
|
https://www.linkedin.com/in/krpeddoddi |
Skilled in | data engineering azure azure data factory azure synapse azure devops databricks delta lake python pyspark sql pl sql apache airflow power bi data pipelines etl ely big data streaming data data integration informatica powercenter aws ci cd data governance data analytics sql server oracle snowflake ssis ssas ssrs data visualization python pandas numpy shell scripting data modeling business intelligence metadata management |
Fluent in | english |
Preferred timezone | 0,+1,+2,+3 |
Preferred annual pay (min) | $150,000/year |
Preferred hourly pay (min) | $550/hour |
Last seen | 1 month ago |
Signed up | 1 month ago |
Badges |
๐จโ๐ป Remote worker ๐ Early adopter |
2019 - 2025: Azure Data Engineer @ HCL Netherlands BV
2010 - 2019: BI Consultant, Informatica ETL Technical Consultant @ Capgemini, Cognizant, HCL Netherlands