I have developed and streamlined the data migration pipeline for moving data from GCP to AWS using PySpark while reducing the cost of data transfer and improving data availability for enhanced product analysis. Additionally, I've migrated data from SQL and NoSQL databases to Redshift. Enhanced database efficiency and compatibility through optimized SQL queries and procedures. Engaging closely with stakeholders, I've translated business needs into actionable insights through QuickSight reports and automation scripts and constructed comprehensive dashboards displaying critical KPIs for streamlined monitoring and proactive decision-making. Leveraging Python scripting and AWS services such as Lambda and Glue, I've automated manual tasks, reducing repetitive workload by 80% and allowing for better resource allocation. Furthermore, I've developed a data reporting web application using Streamlit, effectively optimizing reporting processes and reducing manual efforts. I'm seeking a data engineer position where I can apply my expertise to contribute to the development of products or services.
| ๐ Nationality | ๐ฎ๐ณ India |
| ๐ก Residency | ๐ฎ๐ณ India |
| ๐ Location | ๐ฎ๐ณ India |
|
|
rok.co/@rajgandhi18 |
|
|
sdfljasfjkhsdfajsf โญ๏ธ Upgrade to Premium to contact |
|
|
sdfljasfjkhsdfajsf โญ๏ธ Upgrade to Premium to contact |
| Skilled in | python scala spark pyspark data analysis data pipeline migration sql nosql etl kafka postgresql awss3 glue lambda emr step function redshift quicksight git docker bigquery mongodb html css js shell scripting bash react node dbtjinja macros packages |
| Fluent in | englishhindigujarati |
| Preferred annual pay (min) | $30,000/year |
| Preferred hourly pay (min) | $10/hour |
| Last seen | 1 year ago |
| Signed up | 1 year ago |
| Badges |
๐จโ๐ป Remote worker ๐จ Maker ๐ Early adopter |
2022 - Now: Data Engineer - I @ BookMyShow
2024 - Now: Real Time Stock Data Migration and Analysis
2018 - 2022: Computer Science @ Mumbai University