I am passionate about providing data solutions that provide meaningful insights to businesses. My experience has taken me to Google Cloud Platform (GCP) and Microsoft Azure, where I've led end-to-end batch data processing pipelines and used a variety of tools such as Lucid, Mage, Python, Pandas, GCE, BigQuery, Azure Blob Storage, Synapse Analytics, Data Factory, Azure Databricks, and Azure Event Grid.
My expertise is in developing ETL/ELT processes that transform raw data into relevant insights while adhering to strict data quality and accuracy standards. I specialize in the design and optimization of data models and schemas, as well as the development of efficient storage and retrieval structures for platforms such as BigQuery and Synapse Analytics.
Collaboration is at the heart of my approach. By closely engaging with stakeholders, I've tailored solutions that precisely align with their data needs. Performance optimization is second nature to me โ I've fine-tuned data processing jobs and harnessed cloud-native monitoring tools like "Falco" to elevate monitoring activities within VMs.
My affinity for data modeling is evident in the star schema designs I've developed using Lucid charts, translating intricate data structures into actionable business insights. I've also taken charge of security and compliance, proficiently managing micro-services while actively contributing to streaming data processing pipelines using services like Pub/Sub, Dataflow, and Event Grid.
Skills at a glance:
* Google Cloud Platform (GCP): BigQuery, Composer, Cloud Storage, Dataflow, Pub/Sub, Apache Beam.
* Microsoft Azure: Blob Storage, Synapse Analytics, Data Factory, Azure Databricks
* Data Warehousing: Dimensional modelling, ETL/ELT processes, schema design.
* Programming Languages and Libraries: Python, PySpark, Pandas, SQL.
* Data Integration and Orchestration: Apache Airflow.
* Database Technologies: MySQL, MongoDB.
* Version Control and Project Management: Git, Jira, Bitbucket
* Strong analytical and problem-solving skills complemented by a thirst for new technologies.
Connect with me to embark on a journey of data-driven transformation.
| ๐ Nationality | ๐ฎ๐ณ India |
| ๐ก Residency | ๐ฎ๐ณ India |
| ๐ Location | ๐ฎ๐ณ India |
|
|
rok.co/@apoorv_tyagi |
|
|
sdfljasfjkhsdfajsf โญ๏ธ Upgrade to Premium to contact |
|
|
sdfljasfjkhsdfajsf โญ๏ธ Upgrade to Premium to contact |
| Skilled in | google cloud platform gcp bigquery composer cloud storage dataflow pub sub apache beam azure blob storage azure synapse analytics azure data factory azure databricks data warehousing etl elt processes python pyspark pandas sql apache airflow git jira bitbucket |
| Fluent in | englishhindi |
| Preferred annual pay (min) | $50,000/year |
| Preferred hourly pay (min) | $25/hour |
| Last seen | 2 years ago |
| Signed up | 2 years ago |
| Badges |
๐จโ๐ป Remote worker ๐ Early adopter |
2022 - Now: Senior associate consultant @ Infosys
2019 - 2022: Python developer @ Tata consultancy services
2015 - 2019: Computer science engineer @ Kurukshetra university