As an experienced Big Data Engineer with 4 years of experience, I am passionate about building efficient and reliable data pipelines. My background as both a Data Platform Engineer and a Data Analyst has given me a unique perspective on the end-to-end data lifecycle, from ingestion to transformation and analysis.
In my previous role in a financial institution, I contributed to the development of an application that streamlined data management in a Data Lake. Additionally, I developed a Transformer-based model that recognized GDPR sensitive data in documents, which helped the bank comply with regulations. I have also developed an application to convert daily table snapshots into historical data and a dynamic Deep Learning multi-class model able to determine the golden source of corporate table columns.
Currently, I am part of the Processing team of a media platform where I optimize queries and generate data pipelines to manage them, ensuring that data is processed efficiently and accurately.
My skills in Python, Scala, Java and tools for Data Orchestration (such as Airflow) enable me to build robust and scalable data pipelines. I am excited to leverage my skills and experience in a challenging role as a Big Data Engineer. Please feel free to connect with me to discuss potential opportunities.
๐ Nationality | ๐ฎ๐น Italy |
๐ก Residency | ๐ฎ๐น Italy |
๐ Location | ๐ฎ๐น Italy |
Remote OK | rok.co/@mikaelrt |
GitHub | michaelpetrolini |
https://www.linkedin.com/in/michael-petrolini | |
michael_petrolini | |
Skilled in | gcp bigquery airflow spark mongodb hadoop sql etl java python scala hbase hive |
Fluent in | italianenglish |
Preferred annual pay (min) | $80,000/year |
Last seen | 5 months ago |
Signed up | 10 months ago |
Badges |
๐จโ๐ป Remote worker ๐จ Maker ๐ Early adopter |
2022 - Now: query-explorer
2021 - 2022: Publication: Automatic Detection of Sensitive Data Using Transformer- Based Classifiers
2020 - 2021: snapshot-merger
2019 - 2022: Master's Degree in Computer Science @ Universitร degli Studi di Parma
2014 - 2019: Bachelor's Degree in Computer Engineering @ Universitร degli Studi di Parma