Remote worker with 3+ years of experience - Last seen 7 months ago

Experienced Senior Data Engineer with 18 years of success delivering enterprise-scale Big Data, Cloud, and ETL
solutions. Highly skilled in designing and implementing modern data platforms using Azure Synapse Analytics,
Azure Data Factory (ADF), Azure Databricks, Azure Blob Storage, and Azure Event Hubs.
Over the past 5+ years, have led the development of scalable, cloud-native data ingestion and transformation
pipelines using Python, PySpark, Airbyte, LakeFS, and RabbitMQ. Designed and implemented custom Airbyte
connectors, including a Delta Sharing source connector and a LakeFS destination connector, enabling versioned,
secure data sharing across data lakes backed by MinIO and Azure Blob Storage.
Hands-on experience integrating Delta Lake with LakeFS for data versioning, orchestrating ETL workflows in
Azure Databricks, and managing containerized test environments using Docker, pytest, and reverse proxy auth
for Delta Sharing. Skilled in automating end-to-end pipelines with ADF, querying and transforming big data
workloads in Azure Synapse, and leveraging Azure Functions for event-driven processing.
Proven ability to build high-performance, distributed data pipelines, implement asynchronous streaming
architectures, and drive adoption of best practices in Azure-based data lake architecture, Delta Sharing
protocol, and governed, secure, cloud-scale analytics platforms.

🛂 Nationality	🇮🇳 India
🏡 Residency	🇮🇳 India
📍 Location	🇮🇳 India
Remote OK	rok.co/@ramkunwaryadav
X	sdfljasfjkhsdfajsf ⭐️ Upgrade to Premium to contact
LinkedIn	sdfljasfjkhsdfajsf ⭐️ Upgrade to Premium to contact
Skilled in	azure data factory python pyspark java lakefs minio docker deltalake mysql airbyte
Fluent in	englishhindi
Preferred timezone	+91
Preferred annual pay (min)	$5,000/year
Preferred hourly pay (min)	$40/hour
Last seen	7 months ago
Signed up	7 months ago
Badges	👨‍💻 Remote worker 🎨 Maker